00010000:00010000:2.0F:1789446149.094326:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0F:1789446149.875797:0:17241:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:1.0:1789446149.875831:0:17241:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c2c0188da80 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:1.0:1789446149.875836:0:17241:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c2d08634b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c2c0188df00 00000020:00080000:1.0:1789446149.875840:0:17241:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c2d08634700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c2c0751b800 00000020:00080000:3.0F:1789446149.876241:0:17300:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:3.0:1789446149.876381:0:17300:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1789446149.883951:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d35ea7800/0x62554ff374550558 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446149.883976:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d35ea7800/0x62554ff374550558 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446149.883984:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d35ea7800/0x62554ff374550558 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446149.883989:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d35ea7800 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:2.0:1789446149.883993:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d35ea7800/0x62554ff374550558 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446149.884000:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d35ea7800/0x62554ff374550558 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446149.884016:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:2.0:1789446149.884018:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789446149.884023:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d35ea7800/0x62554ff374550558 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446149.884028:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d35ea7800/0x62554ff374550558 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0F:1789446150.120174:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446150.374225:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789446150.374249:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794615936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789446150.374461:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446150.374567:0:18769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794615936 00000100:00100000:2.0:1789446150.374575:0:18769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794615936 00000100:00100000:2.0:1789446150.374634:0:18769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789446150.374643:0:18769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794615936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789446150.374672:0:18769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789446150.374729:0:18769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794615936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446150.374749:0:18769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789446150.374815:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789446150.374856:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794615936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789446150.888235:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d07f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1876369794616192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789446150.888307:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446150.888358:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789446150.888366:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3fe73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794616064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789446150.888388:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446150.888415:0:18001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794616192 00000100:00100000:1.0:1789446150.888421:0:18001:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794616192 00000100:00100000:1.0:1789446150.888460:0:18001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794616064 00000100:00100000:1.0:1789446150.888463:0:18001:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794616064 00000100:00100000:1.0:1789446150.888481:0:18001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789446150.888490:0:18001:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d07f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1876369794616192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789446150.888522:0:18001:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789446150.888564:0:18001:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d07f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1876369794616192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446150.888571:0:18001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789446150.888593:0:18001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789446150.888599:0:18001:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d07f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794616064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789446150.888615:0:18001:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1789446150.888641:0:18001:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d07f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794616064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 42us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446150.888647:0:18001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789446150.888775:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3fe73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794616064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789446150.888788:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d07f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1876369794616192:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789446151.142902:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789446151.265087:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446151.265135:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446151.265164:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446151.265191:0:17263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773569792 00000100:00100000:1.0:1789446151.265202:0:17263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773569792 00000100:00100000:1.0:1789446151.265270:0:17263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773569664 00000100:00100000:1.0:1789446151.265274:0:17263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773569664 00000100:00100000:1.0:1789446151.265301:0:17263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00100000:1.0:1789446151.265312:0:17263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d07f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+5:2405:x1876369773569792:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789446151.265385:0:17263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d07f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+5:2405:x1876369773569792:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 74us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446151.265397:0:17263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00100000:1.0:1789446151.265415:0:17263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 71 00000100:00100000:1.0:1789446151.265422:0:17263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d07f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+13:2405:x1876369773569664:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789446151.265447:0:17263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d07f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+13:2405:x1876369773569664:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 26us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446151.265454:0:17263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 71 00000100:00080000:1.0:1789446151.265480:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789446151.265495:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789446151.265653:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773569536 00000100:00100000:2.0:1789446151.265659:0:17256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773569536 00000100:00100000:2.0:1789446151.265776:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 168 00000100:00100000:2.0:1789446151.265784:0:17256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2eca0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65c2231-c3aa-4a28-bbc7-c4cd07dee5d6+13:2405:x1876369773569536:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789446151.265817:0:17256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2eca0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a65c2231-c3aa-4a28-bbc7-c4cd07dee5d6+13:2405:x1876369773569536:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 35us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446151.265823:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 168 00000100:00100000:1.0:1789446151.270095:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446151.270176:0:18765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773569920 00000100:00100000:3.0:1789446151.270184:0:18765:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773569920 00000100:00100000:3.0:1789446151.270279:0:18765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:3.0:1789446151.270291:0:18765:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d07f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+5:2403:x1876369773569920:12345-192.168.206.48@tcp:9:kworker.0 00000020:00000080:3.0:1789446151.270318:0:18765:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff374550287 00000100:00080000:3.0:1789446151.270333:0:18765:0:(import.c:65:import_set_state_nolock()) ffff9c2c065d9000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789446151.270375:0:18765:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1789446151.270535:0:18765:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d07f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+2:2403:x1876369773569920:12345-192.168.206.48@tcp:9:kworker.0 Request processed in 247us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446151.270543:0:18765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 27 00010000:00010000:3.0:1789446151.270590:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789446151.270910:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789446151.284834:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446151.284877:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446151.284904:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446151.284926:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446151.284950:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446151.285012:0:17263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773570176 00000100:00100000:2.0:1789446151.285022:0:17263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773570176 00000100:00100000:3.0:1789446151.285116:0:19708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773570048 00000100:00100000:2.0:1789446151.285118:0:17263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773570304 00000100:00100000:3.0:1789446151.285122:0:19708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773570048 00000100:00100000:2.0:1789446151.285124:0:17263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773570304 00000100:00100000:2.0:1789446151.285162:0:17263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00100000:2.0:1789446151.285173:0:17263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c0828d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e662eab-64e8-474c-9462-3d611ecfc6a7+6:2405:x1876369773570176:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789446151.285193:0:19708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773570432 00000100:00100000:3.0:1789446151.285197:0:19708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773570432 00000100:00100000:3.0:1789446151.285219:0:19708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773570560 00000100:00100000:3.0:1789446151.285222:0:19708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773570560 00000100:00100000:2.0:1789446151.285248:0:17263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c0828d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e662eab-64e8-474c-9462-3d611ecfc6a7+6:2405:x1876369773570176:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 78us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446151.285256:0:17263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00100000:2.0:1789446151.285286:0:17263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 73 00000100:00100000:2.0:1789446151.285293:0:17263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c0828e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e662eab-64e8-474c-9462-3d611ecfc6a7+5:2404:x1876369773570304:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789446151.285320:0:17263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c0828e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e662eab-64e8-474c-9462-3d611ecfc6a7+5:2404:x1876369773570304:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 27us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446151.285335:0:17263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 73 00000100:00100000:3.0:1789446151.285363:0:19708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:3.0:1789446151.285372:0:19708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3fe73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+5:2404:x1876369773570048:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789446151.285401:0:19708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3fe73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+5:2404:x1876369773570048:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 32us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446151.285408:0:19708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:3.0:1789446151.285422:0:19708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:3.0:1789446151.285427:0:19708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c0828ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e662eab-64e8-474c-9462-3d611ecfc6a7+5:2403:x1876369773570432:12345-192.168.206.48@tcp:9:kworker.0 00000020:00000080:3.0:1789446151.285463:0:19708:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff3745502c6 00000100:00080000:3.0:1789446151.285472:0:19708:0:(import.c:65:import_set_state_nolock()) ffff9c2d3df2c000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789446151.285514:0:18766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:2.0:1789446151.285525:0:18766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c0828d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e662eab-64e8-474c-9462-3d611ecfc6a7+5:2403:x1876369773570560:12345-192.168.206.48@tcp:9:kworker.0 00000001:00000004:3.0:1789446151.285535:0:19708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000020:00000080:2.0:1789446151.285544:0:18766:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff3745502cd 00000100:00080000:2.0:1789446151.285558:0:18766:0:(import.c:65:import_set_state_nolock()) ffff9c2d112fd800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789446151.285596:0:18766:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1789446151.285650:0:19708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c0828ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e662eab-64e8-474c-9462-3d611ecfc6a7+2:2403:x1876369773570432:12345-192.168.206.48@tcp:9:kworker.0 Request processed in 221us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446151.285657:0:19708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 28 00010000:00010000:3.0:1789446151.285729:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446151.285781:0:18766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c0828d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e662eab-64e8-474c-9462-3d611ecfc6a7+2:2403:x1876369773570560:12345-192.168.206.48@tcp:9:kworker.0 Request processed in 259us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446151.285789:0:18766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00080000:2.0:1789446151.285807:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789446151.285812:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789446151.285813:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789446151.285815:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789446151.286246:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446151.399171:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794616320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789446151.399236:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446151.399270:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789446151.399276:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794616448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789446151.399294:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446151.399318:0:18769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794616320 00000100:00100000:0.0:1789446151.399323:0:18769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794616320 00000100:00100000:0.0:1789446151.399362:0:18769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794616448 00000100:00100000:0.0:1789446151.399366:0:18769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794616448 00000100:00100000:0.0:1789446151.399389:0:18769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789446151.399400:0:18769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d35cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794616320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789446151.399429:0:18769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1789446151.399465:0:18769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d35cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794616320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446151.399471:0:18769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789446151.399486:0:18769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789446151.399491:0:18769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d35cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794616448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789446151.399498:0:18769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789446151.399517:0:18769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d35cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794616448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 27us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446151.399522:0:18769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1789446151.399550:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789446151.399554:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789446151.399564:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08190380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876369794616960:0@lo:400:kworker.0 00000100:00100000:3.0:1789446151.399585:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c0828df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3657:1876369794616576:0@lo:400:kworker.0 00000100:00100000:0.0:1789446151.399594:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446151.399615:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1876369794617472:0@lo:400:kworker.0 00000100:00100000:1.0:1789446151.399671:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794616832:0@lo:400:kworker.0 00000100:00100000:0.0:1789446151.401665:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446151.401671:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446151.401723:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876369794617344:0@lo:400:kworker.0 00000100:00100000:1.0:1789446151.401753:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446151.401780:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1876369794617856:0@lo:400:kworker.0 00000100:00100000:1.0:1789446151.401804:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446151.401804:0:17263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794616960 00000100:00100000:0.0:1789446151.401813:0:17263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794616960 00000100:00100000:1.0:1789446151.401844:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794616448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789446151.401858:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794616320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789446151.401885:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c0828dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1876369794616704:0@lo:400:kworker.0 00000100:00100000:1.0:1789446151.401907:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446151.401930:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794617216:0@lo:400:kworker.0 00000100:00100000:3.0:1789446151.401937:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446151.401950:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446151.402000:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794617088:0@lo:400:kworker.0 00000100:00100000:0.0:1789446151.402030:0:17263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794617472 00000100:00100000:3.0:1789446151.402031:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446151.402071:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1876369794617728:0@lo:400:kworker.0 00000100:00100000:0.0:1789446151.402083:0:17263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794617472 00000100:00100000:1.0:1789446151.402102:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446151.402120:0:17263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794617344 00000100:00100000:0.0:1789446151.402124:0:17263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794617344 00000100:00100000:2.0:1789446151.402138:0:20169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794617856 00000100:00100000:3.0:1789446151.402144:0:17255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794616576 00000100:00100000:0.0:1789446151.402144:0:17263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794617728 00000100:00100000:2.0:1789446151.402145:0:20169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794617856 00000100:00100000:0.0:1789446151.402150:0:17263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794617728 00000100:00100000:3.0:1789446151.402152:0:17255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794616576 00000100:00100000:1.0:1789446151.402159:0:19708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794616832 00000100:00100000:1.0:1789446151.402165:0:19708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794616832 00000100:00100000:2.0:1789446151.402187:0:20169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789446151.402196:0:20169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d35cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876369794616960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446151.402201:0:19708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794617216 00000100:00100000:3.0:1789446151.402203:0:17255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789446151.402205:0:19708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794617216 00000100:00100000:3.0:1789446151.402217:0:17255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2eca0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c2066a7-cdc1-4793-80dc-4607cc2d2086+24:3657:x1876369794616576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446151.402229:0:19708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789446151.402239:0:19708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d07f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794616832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446151.402243:0:20169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d35cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876369794616960:12345-0@lo:400:kworker.0 Request processed in 50us (2650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446151.402281:0:17255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2eca0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c2066a7-cdc1-4793-80dc-4607cc2d2086+24:3657:x1876369794616576:12345-0@lo:400:kworker.0 Request processed in 69us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446151.402289:0:17255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789446151.402295:0:19708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d07f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794616832:12345-0@lo:400:kworker.0 Request processed in 55us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446151.402303:0:19708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789446151.402326:0:19708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789446151.402333:0:19708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d07f04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794617216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446151.402445:0:19708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d07f04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794617216:12345-0@lo:400:kworker.0 Request processed in 112us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446151.402451:0:19708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789446151.402499:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794617216:0@lo:400:kworker.0 00000100:00100000:0.0:1789446151.403480:0:17263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789446151.403492:0:17263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d35cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876369794617472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446151.403537:0:17263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d35cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876369794617472:12345-0@lo:400:kworker.0 Request processed in 49us (1874us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446151.403544:0:17263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789446151.403564:0:17263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789446151.403570:0:17263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d07f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876369794617344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446151.403597:0:17263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d07f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876369794617344:12345-0@lo:400:kworker.0 Request processed in 28us (1844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446151.403603:0:17263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789446151.403615:0:17263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789446151.403621:0:17263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d07f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876369794617856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446151.403644:0:17263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d07f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876369794617856:12345-0@lo:400:kworker.0 Request processed in 25us (1841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446151.403657:0:17263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789446151.403682:0:17263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789446151.403688:0:17263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d07f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1876369794617728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446151.403792:0:17263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d07f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1876369794617728:12345-0@lo:400:kworker.0 Request processed in 104us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446151.403799:0:17263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1789446151.403816:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789446151.403821:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789446151.403823:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789446151.403834:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1876369794617984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789446151.403926:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446151.403981:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08190380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876369794616960:0@lo:400:kworker.0 00000100:00100000:0.0:1789446151.403994:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1876369794617472:0@lo:400:kworker.0 00000100:00100000:0.0:1789446151.404020:0:18769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794617984 00000100:00100000:0.0:1789446151.404025:0:18769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794617984 00000100:00100000:0.0:1789446151.404254:0:18769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789446151.404263:0:18769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d35cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876369794617984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789446151.404289:0:18769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1789446151.404324:0:18769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d35cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876369794617984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446151.404330:0:18769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789446151.404368:0:20169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789446151.404426:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1876369794617728:0@lo:400:kworker.0 00000100:00100000:0.0:1789446151.404456:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1876369794617984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789446151.404493:0:17266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794616704 00000100:00100000:0.0:1789446151.404501:0:17266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794616704 00000100:00100000:0.0:1789446151.404604:0:17266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794617088 00000100:00100000:0.0:1789446151.404607:0:17266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794617088 00000100:00100000:1.0:1789446151.405652:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794616832:0@lo:400:kworker.0 00000100:00100000:1.0:1789446151.405676:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876369794617344:0@lo:400:kworker.0 00010000:00080000:1.0:1789446151.405691:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2c05a79f80 x1876369794617856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789446151.405702:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1876369794617856:0@lo:400:kworker.0 00000100:00100000:1.0:1789446151.408899:0:18001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789446151.408920:0:18001:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d07f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1876369794616704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446151.409037:0:18001:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d07f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1876369794616704:12345-0@lo:400:kworker.0 Request processed in 127us (7129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446151.409045:0:18001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789446151.409066:0:18001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789446151.409072:0:18001:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794617088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446151.409100:0:18001:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794617088:12345-0@lo:400:kworker.0 Request processed in 29us (7070us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446151.409106:0:18001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789446151.409151:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794617088:0@lo:400:kworker.0 00000100:00100000:1.0:1789446151.409161:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1876369794617600:0@lo:400:kworker.0 00000100:00100000:1.0:1789446151.409193:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446151.409236:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c0828df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3657:1876369794616576:0@lo:400:kworker.0 00000100:00100000:3.0:1789446151.411307:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c0828dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1876369794616704:0@lo:400:kworker.0 00000100:00100000:0.0:1789446151.413195:0:17262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794617600 00000100:00100000:0.0:1789446151.413207:0:17262:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794617600 00000100:00080000:0.0:1789446151.413234:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789446151.413271:0:17262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789446151.413280:0:17262:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d07f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1876369794617600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446151.413356:0:17262:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d07f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1876369794617600:12345-0@lo:400:kworker.0 Request processed in 77us (4162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446151.413363:0:17262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:0.0:1789446151.413403:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2c05a79c00 x1876369794617600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446151.413418:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1876369794617600:0@lo:400:kworker.0 00000100:00100000:3.0:1789446151.839248:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446151.839328:0:17261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773570688 00000100:00100000:1.0:1789446151.839337:0:17261:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773570688 00000100:00100000:1.0:1789446151.839393:0:17261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:1.0:1789446151.839403:0:17261:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+13:15609:x1876369773570688:12345-192.168.206.48@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789446151.839496:0:17261:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+13:15609:x1876369773570688:12345-192.168.206.48@tcp:60:lhsmtool_posix.0 Request processed in 94us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446151.839516:0:17261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:2.0:1789446151.844771:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446151.844838:0:20169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773570816 00000100:00100000:0.0:1789446151.844849:0:20169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773570816 00000100:00100000:0.0:1789446151.844906:0:20169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00100000:0.0:1789446151.844916:0:20169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+5:15609:x1876369773570816:12345-192.168.206.48@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789446151.845267:0:20169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+5:15609:x1876369773570816:12345-192.168.206.48@tcp:60:lhsmtool_posix.0 Request processed in 350us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446151.845276:0:20169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 66 00000040:00080000:3.0:1789446151.846739:0:18013:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789446151.867564:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446151.868305:0:17264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773571072 00000100:00100000:2.0:1789446151.868328:0:17264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773571072 00000100:00100000:2.0:1789446151.868383:0:17264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:2.0:1789446151.868394:0:17264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+13:15609:x1876369773571072:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789446151.868645:0:17264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+14:15609:x1876369773571072:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 252us (1090us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1789446151.868652:0:17264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00010000:00010000:3.0:1789446152.166230:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446153.190603:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446154.220036:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789446154.224279:0:20640:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 00:22:32 (1789446152) 00010000:00010000:3.0:1789446155.239563:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446155.497286:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d35cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794618112:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789446155.497362:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446155.497425:0:18769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794618112 00000100:00100000:0.0:1789446155.497432:0:18769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794618112 00000100:00100000:0.0:1789446155.497482:0:18769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789446155.497491:0:18769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794618112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789446155.497520:0:18769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789446155.497562:0:18769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794618112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446155.497583:0:18769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1789446155.497606:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789446155.497640:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d35cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794618112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789446156.006364:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794618240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789446156.006504:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446156.006832:0:18001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794618240 00000100:00100000:1.0:1789446156.006840:0:18001:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794618240 00000100:00100000:1.0:1789446156.006900:0:18001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789446156.006910:0:18001:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794618240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789446156.006941:0:18001:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1789446156.007022:0:18001:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794618240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446156.007028:0:18001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789446156.007702:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789446156.007715:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1876369794618368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789446156.007753:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446156.007796:0:17267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794618368 00000100:00100000:0.0:1789446156.007801:0:17267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794618368 00000100:00100000:0.0:1789446156.007829:0:17267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789446156.007836:0:17267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1876369794618368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789446156.007857:0:17267:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789446156.007908:0:17267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1876369794618368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446156.007914:0:17267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789446156.007953:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1876369794618368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789446156.014160:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07b78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794618240:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1789446156.014930:0:17241:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1789446156.014941:0:17241:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:1.0:1789446156.014989:0:17300:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:1.0:1789446156.015005:0:17300:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:3.0:1789446156.263587:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789446156.380242:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446156.380275:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446156.380293:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446156.380320:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446156.380355:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446156.380394:0:17263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773571456 00000100:00100000:0.0:1789446156.380403:0:17263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773571456 00000100:00100000:0.0:1789446156.380457:0:17263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773571328 00000100:00100000:0.0:1789446156.380460:0:17263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773571328 00000100:00100000:1.0:1789446156.380468:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773571200 00000100:00100000:1.0:1789446156.380474:0:17253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773571200 00000100:00100000:0.0:1789446156.380489:0:17263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773571840 00000100:00100000:0.0:1789446156.380493:0:17263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773571840 00000100:00100000:1.0:1789446156.380509:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 170 00000100:00100000:0.0:1789446156.380517:0:17263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 80 00000100:00100000:1.0:1789446156.380523:0:17253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2eca1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65c2231-c3aa-4a28-bbc7-c4cd07dee5d6+13:2405:x1876369773571200:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789446156.380530:0:17263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d07f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+5:2405:x1876369773571456:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789446156.380584:0:17263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d07f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+5:2405:x1876369773571456:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 58us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446156.380592:0:17263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 80 00000100:00100000:0.0:1789446156.380618:0:17263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 81 00000100:00100000:0.0:1789446156.380624:0:17263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c0828dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+13:2404:x1876369773571328:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789446156.380807:0:18766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773571584 00000100:00100000:3.0:1789446156.380812:0:18766:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773571584 00000100:00100000:2.0:1789446156.381335:0:20169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 82 00000100:00100000:2.0:1789446156.381345:0:20169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e662eab-64e8-474c-9462-3d611ecfc6a7+5:2404:x1876369773571840:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789446156.381353:0:18766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:3.0:1789446156.381360:0:18766:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c0828df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+5:2404:x1876369773571584:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789446156.381428:0:17253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2eca1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a65c2231-c3aa-4a28-bbc7-c4cd07dee5d6+13:2405:x1876369773571200:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 909us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446156.381438:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 170 00000100:00100000:0.0:1789446156.381439:0:17263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c0828dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+13:2404:x1876369773571328:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 812us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446156.381448:0:17263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 81 00000100:00080000:0.0:1789446156.381471:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789446156.381476:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789446156.381477:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789446156.382085:0:20169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e662eab-64e8-474c-9462-3d611ecfc6a7+5:2404:x1876369773571840:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 739us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446156.382094:0:20169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 82 00000100:00100000:3.0:1789446156.383735:0:18766:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c0828df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+5:2404:x1876369773571584:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 2367us (3405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446156.383746:0:18766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:1.0:1789446156.386868:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446156.387229:0:17263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773571712 00000100:00100000:2.0:1789446156.387239:0:17263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773571712 00000100:00100000:2.0:1789446156.387350:0:17263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 83 00000100:00100000:2.0:1789446156.387360:0:17263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e662eab-64e8-474c-9462-3d611ecfc6a7+6:2405:x1876369773571712:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789446156.387429:0:17263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e662eab-64e8-474c-9462-3d611ecfc6a7+6:2405:x1876369773571712:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 71us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446156.387436:0:17263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 83 00000100:00080000:3.0:1789446156.387727:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789446156.518308:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876369794618880:0@lo:400:kworker.0 00000100:00100000:2.0:1789446156.518375:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446156.518408:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1876369794619392:0@lo:400:kworker.0 00000100:00100000:2.0:1789446156.518443:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446156.518465:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789446156.518471:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3659:1876369794618496:0@lo:400:kworker.0 00000100:00100000:2.0:1789446156.518497:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446156.518523:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794619008:0@lo:400:kworker.0 00000100:00100000:2.0:1789446156.518545:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446156.518561:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1876369794619520:0@lo:400:kworker.0 00000100:00100000:2.0:1789446156.518581:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446156.518603:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1876369794618624:0@lo:400:kworker.0 00000100:00100000:2.0:1789446156.518624:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446156.518639:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794619136:0@lo:400:kworker.0 00000100:00100000:2.0:1789446156.518658:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446156.518673:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1876369794619648:0@lo:400:kworker.0 00000100:00100000:2.0:1789446156.518722:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446156.518743:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789446156.518749:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1876369794618752:0@lo:400:kworker.0 00000100:00100000:2.0:1789446156.518769:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446156.518797:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1876369794619264:0@lo:400:kworker.0 00000100:00100000:2.0:1789446156.518818:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446156.518829:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1876369794619776:0@lo:400:kworker.0 00000100:00100000:2.0:1789446156.518846:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446156.518880:0:20169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794618880 00000100:00100000:2.0:1789446156.518888:0:20169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794618880 00000100:00100000:2.0:1789446156.519063:0:20169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794619392 00000100:00100000:2.0:1789446156.519068:0:20169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794619392 00000100:00100000:2.0:1789446156.519098:0:20169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794619520 00000100:00100000:2.0:1789446156.519101:0:20169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794619520 00000100:00100000:2.0:1789446156.519113:0:20169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794619648 00000100:00100000:2.0:1789446156.519115:0:20169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794619648 00000100:00100000:2.0:1789446156.519126:0:20169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794619264 00000100:00100000:2.0:1789446156.519128:0:20169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794619264 00000100:00100000:2.0:1789446156.519136:0:20169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794619776 00000100:00100000:2.0:1789446156.519138:0:20169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794619776 00000100:00100000:2.0:1789446156.519153:0:20169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789446156.519161:0:20169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876369794618880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446156.519214:0:20169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876369794618880:12345-0@lo:400:kworker.0 Request processed in 54us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446156.519221:0:20169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789446156.519249:0:20169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789446156.519256:0:20169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876369794619392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446156.519284:0:20169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876369794619392:12345-0@lo:400:kworker.0 Request processed in 29us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446156.519290:0:20169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789446156.519303:0:20169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789446156.519309:0:20169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876369794619520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446156.519332:0:20169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876369794619520:12345-0@lo:400:kworker.0 Request processed in 24us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446156.519338:0:20169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789446156.519351:0:20169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789446156.519356:0:20169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1876369794619648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446156.519383:0:20169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1876369794619648:12345-0@lo:400:kworker.0 Request processed in 28us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446156.519397:0:20169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789446156.519411:0:20169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789446156.519417:0:20169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1876369794619264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446156.519443:0:20169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1876369794619264:12345-0@lo:400:kworker.0 Request processed in 27us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446156.519448:0:20169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789446156.519461:0:20169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789446156.519467:0:20169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1876369794619776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446156.519491:0:20169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1876369794619776:12345-0@lo:400:kworker.0 Request processed in 25us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446156.519496:0:20169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789446156.519516:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794618496 00000100:00100000:2.0:1789446156.519519:0:17256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794618496 00000100:00100000:2.0:1789446156.519545:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789446156.519551:0:17256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2eca2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c2066a7-cdc1-4793-80dc-4607cc2d2086+24:3659:x1876369794618496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446156.519577:0:17256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2eca2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c2066a7-cdc1-4793-80dc-4607cc2d2086+24:3659:x1876369794618496:12345-0@lo:400:kworker.0 Request processed in 27us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446156.519583:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789446156.519629:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3659:1876369794618496:0@lo:400:kworker.0 00010000:00080000:2.0:1789446156.519642:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2c05a79180 x1876369794619520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446156.519653:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1876369794619520:0@lo:400:kworker.0 00000100:00100000:2.0:1789446156.519662:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876369794618880:0@lo:400:kworker.0 00000100:00100000:2.0:1789446156.519698:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1876369794619392:0@lo:400:kworker.0 00000100:00100000:2.0:1789446156.519736:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1876369794619264:0@lo:400:kworker.0 00010000:00080000:2.0:1789446156.519746:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2c05a78000 x1876369794619776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446156.519754:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1876369794619776:0@lo:400:kworker.0 00000100:00100000:2.0:1789446156.519763:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1876369794619648:0@lo:400:kworker.0 00000100:00080000:3.0:1789446156.520092:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789446156.520096:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789446156.521951:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794619904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789446156.522023:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446156.522068:0:18769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794619904 00000100:00100000:2.0:1789446156.522075:0:18769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794619904 00000100:00100000:2.0:1789446156.522121:0:18769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789446156.522129:0:18769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794619904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789446156.522155:0:18769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789446156.522193:0:18769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794619904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446156.522201:0:18769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789446156.522251:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794619904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789446156.526054:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1876369794620032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789446156.526122:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789446156.526173:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789446156.526285:0:18769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794620032 00000100:00100000:3.0:1789446156.526292:0:18769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794620032 00000100:00100000:3.0:1789446156.526345:0:18769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789446156.526354:0:18769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876369794620032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789446156.526375:0:18769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1789446156.526420:0:18769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876369794620032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446156.526427:0:18769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789446156.526471:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07b7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1876369794620032:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789446156.526514:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789446156.533225:0:19708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794619008 00000100:00100000:1.0:1789446156.533238:0:19708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794619008 00000100:00100000:1.0:1789446156.533281:0:19708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794618624 00000100:00100000:1.0:1789446156.533285:0:19708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794618624 00000100:00100000:1.0:1789446156.533305:0:19708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794619136 00000100:00100000:1.0:1789446156.533308:0:19708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794619136 00000100:00100000:1.0:1789446156.533318:0:19708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794618752 00000100:00100000:1.0:1789446156.533320:0:19708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794618752 00000100:00100000:1.0:1789446156.533336:0:19708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789446156.533344:0:19708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794619008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446156.533429:0:19708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794619008:12345-0@lo:400:kworker.0 Request processed in 85us (14882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446156.533436:0:19708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789446156.533452:0:19708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789446156.533457:0:19708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3657:x1876369794618624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446156.533492:0:19708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3657:x1876369794618624:12345-0@lo:400:kworker.0 Request processed in 34us (14866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446156.533498:0:19708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789446156.533509:0:19708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789446156.533514:0:19708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794619136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446156.533540:0:19708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794619136:12345-0@lo:400:kworker.0 Request processed in 26us (14881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446156.533545:0:19708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789446156.533555:0:19708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789446156.533561:0:19708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3657:x1876369794618752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446156.533587:0:19708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3657:x1876369794618752:12345-0@lo:400:kworker.0 Request processed in 26us (14817us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446156.533603:0:19708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789446156.533694:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1876369794620160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789446156.533728:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446156.533765:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1876369794618752:0@lo:400:kworker.0 00000100:00100000:1.0:1789446156.533775:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1876369794618624:0@lo:400:kworker.0 00000100:00080000:3.0:1789446156.533926:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789446156.533949:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794619008:0@lo:400:kworker.0 00000100:00100000:3.0:1789446156.533990:0:18769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794620160 00000100:00100000:3.0:1789446156.534000:0:18769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794620160 00000100:00100000:3.0:1789446156.534025:0:18769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789446156.534031:0:18769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1876369794620160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789446156.534045:0:18769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789446156.534079:0:18769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1876369794620160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446156.534084:0:18769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789446156.534381:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794619136:0@lo:400:kworker.0 00000100:00100000:1.0:1789446156.534413:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1876369794620160:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1789446157.038510:0:18762:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9e662eab-64e8-474c-9462-3d611ecfc6a7 00000020:00000080:0.0:1789446157.038520:0:18762:0:(genops.c:885:class_export_put()) final put ffff9c2d3df2e000/9e662eab-64e8-474c-9462-3d611ecfc6a7 00000001:00100000:0.0:1789446157.038544:0:18762:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e79b41b2-79c3-4831-ae5f-f4f0cf0e5595 00000020:00000080:0.0:1789446157.038546:0:18762:0:(genops.c:885:class_export_put()) final put ffff9c2c065d9800/e79b41b2-79c3-4831-ae5f-f4f0cf0e5595 00000020:00000080:2.0:1789446157.040436:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3df2e000/9e662eab-64e8-474c-9462-3d611ecfc6a7 for lustre-OST0000 00000020:00000080:2.0:1789446157.040504:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c065d9800/e79b41b2-79c3-4831-ae5f-f4f0cf0e5595 for lustre-OST0000 00000020:00000080:2.0:1789446157.040521:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d3df2c000 for lustre-OST0000 00000020:00000080:2.0:1789446157.040526:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2c065d9000 for lustre-OST0000 00000001:00100000:1.0:1789446157.041856:0:19580:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9e662eab-64e8-474c-9462-3d611ecfc6a7 00000020:00000080:1.0:1789446157.041862:0:19580:0:(genops.c:885:class_export_put()) final put ffff9c2d112fd000/9e662eab-64e8-474c-9462-3d611ecfc6a7 00000020:00000080:0.0:1789446157.041938:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d112fd000/9e662eab-64e8-474c-9462-3d611ecfc6a7 for lustre-OST0001 00000020:00000080:0.0:1789446157.042006:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d112fd800 for lustre-OST0001 00010000:00010000:1.0:1789446157.286372:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789446157.990170:0:17294:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789446157.990179:0:17294:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789446157.990201:0:17294:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789446157.990210:0:17294:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789446158.019356:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446158.019460:0:17264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773572096 00000100:00100000:2.0:1789446158.019470:0:17264:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773572096 00000100:00100000:2.0:1789446158.019545:0:17264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:2.0:1789446158.019555:0:17264:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+13:16364:x1876369773572096:12345-192.168.206.48@tcp:35:umount.0 00000001:00080000:2.0:1789446158.019784:0:17264:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1789446158.019860:0:17264:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:2.0:1789446158.020198:0:17264:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+16:16364:x1876369773572096:12345-192.168.206.48@tcp:35:umount.0 Request processed in 644us (849us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1789446158.020206:0:17264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000020:00080000:2.0:1789446158.020210:0:17264:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:3.0:1789446158.021153:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789446158.035589:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446158.035673:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446158.035900:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446158.036068:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773572224 00000100:00100000:3.0:1789446158.036077:0:17246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773572224 00000100:00100000:3.0:1789446158.036127:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773572480 00000100:00100000:3.0:1789446158.036130:0:17246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773572480 00000100:00100000:3.0:1789446158.036157:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:3.0:1789446158.036167:0:17246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65c2231-c3aa-4a28-bbc7-c4cd07dee5d6+14:2405:x1876369773572224:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789446158.036182:0:17246:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789446158.036200:0:17246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d42159800/0x62554ff374550264 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a651e0 expref: 14 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446158.036218:0:17246:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789446158.036268:0:17246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65c2231-c3aa-4a28-bbc7-c4cd07dee5d6+13:2405:x1876369773572224:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 102us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446158.036276:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:3.0:1789446158.036294:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:3.0:1789446158.036300:0:17246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ebe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65c2231-c3aa-4a28-bbc7-c4cd07dee5d6+12:2405:x1876369773572480:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789446158.036308:0:17246:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789446158.036317:0:17246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d36a50800/0x62554ff3745502f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a652c7 expref: 12 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446158.036343:0:17246:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789446158.036363:0:17246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ebe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65c2231-c3aa-4a28-bbc7-c4cd07dee5d6+11:2405:x1876369773572480:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 62us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446158.036369:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:2.0:1789446158.041465:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773572352 00000100:00100000:2.0:1789446158.041478:0:17246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773572352 00000100:00100000:2.0:1789446158.041541:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:2.0:1789446158.041552:0:17246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65c2231-c3aa-4a28-bbc7-c4cd07dee5d6+11:2405:x1876369773572352:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789446158.041567:0:17246:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789446158.041585:0:17246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d42158800/0x62554ff37455026b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65211 expref: 11 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446158.041600:0:17246:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789446158.041652:0:17246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65c2231-c3aa-4a28-bbc7-c4cd07dee5d6+10:2405:x1876369773572352:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 103us (5761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446158.041659:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:3.0:1789446158.043542:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446158.043636:0:19708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773572608 00000100:00100000:1.0:1789446158.043645:0:19708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773572608 00000100:00100000:1.0:1789446158.043820:0:19708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:1.0:1789446158.043830:0:19708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+5:2403:x1876369773572608:12345-192.168.206.48@tcp:9:umount.0 00000020:00000080:1.0:1789446158.043862:0:19708:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37455028e 00000100:00080000:1.0:1789446158.043872:0:19708:0:(import.c:65:import_set_state_nolock()) ffff9c2c065da800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789446158.043928:0:19708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1789446158.044269:0:19708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+2:2403:x1876369773572608:12345-192.168.206.48@tcp:9:umount.0 Request processed in 440us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446158.044292:0:19708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 30 00010000:00010000:0.0:1789446158.044349:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789446158.044848:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789446158.063034:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446158.063583:0:20169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773573504 00000100:00100000:2.0:1789446158.063593:0:20169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773573504 00000100:00100000:2.0:1789446158.063657:0:20169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 67 00000100:00100000:2.0:1789446158.063667:0:20169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+16:2403:x1876369773573504:12345-192.168.206.48@tcp:39:umount.0 00000020:00000080:2.0:1789446158.063833:0:20169:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff374550280 00000020:00010000:2.0:1789446158.063850:0:20169:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c2c06780000: total 0 00000100:00080000:2.0:1789446158.063855:0:20169:0:(import.c:65:import_set_state_nolock()) ffff9c2d187ae800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789446158.063890:0:20169:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:2.0:1789446158.064250:0:20169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+15:2403:x1876369773573504:12345-192.168.206.48@tcp:39:umount.0 Request processed in 583us (1222us total) trans 8589934627 rc 0/0 00000100:00100000:2.0:1789446158.064258:0:20169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 67 00000020:00010000:3.0:1789446158.064844:0:17250:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c2c06780000: total 0 00010000:00010000:3.0:1789446158.064850:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446158.064916:0:17250:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c2c06780000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1789446158.064982:0:17250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c2d02f24000) 00010000:00010000:3.0:1789446158.064987:0:17250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789446158.064996:0:17250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807e00/0x62554ff374550589 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65384 expref: 14 pid: 17262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446158.065016:0:17250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c2d02f24900) 00010000:00010000:3.0:1789446158.065019:0:17250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789446158.065022:0:17250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d35ea7000/0x62554ff374550360 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a652d5 expref: 13 pid: 17261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446158.065455:0:17250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2d02f24a00) 00010000:00010000:3.0:1789446158.065458:0:17250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789446158.065464:0:17250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d35ea6400/0x62554ff37455039f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a652e3 expref: 12 pid: 17262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446158.065475:0:17250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:3.0:1789446158.065478:0:17250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789446158.065481:0:17250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d35ea7200/0x62554ff37455052e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65361 expref: 11 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446158.065506:0:17250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c2c067e8200) 00010000:00010000:3.0:1789446158.065508:0:17250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789446158.065512:0:17250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50400/0x62554ff374550344 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a652ce expref: 10 pid: 20169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446158.065525:0:17250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c2d07a88000) 00010000:00010000:3.0:1789446158.065527:0:17250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789446158.065531:0:17250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51a00/0x62554ff374550424 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6530d expref: 9 pid: 17263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446158.065600:0:17250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c2d02f24000) 00010000:00010000:3.0:1789446158.065602:0:17250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789446158.065606:0:17250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00031c00/0x62554ff3745504d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6534c expref: 8 pid: 17261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446158.065617:0:17250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c2d02f24000) 00010000:00010000:3.0:1789446158.065619:0:17250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789446158.065623:0:17250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50200/0x62554ff3745504a2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65337 expref: 7 pid: 17262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446158.065634:0:17250:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c2c06780000, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1789446158.065652:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446158.065654:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446158.065656:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446158.082790:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446158.084826:0:17261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773573632 00000100:00100000:1.0:1789446158.084850:0:17261:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773573632 00000100:00100000:1.0:1789446158.084953:0:17261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:1.0:1789446158.085008:0:17261:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+5:2403:x1876369773573632:12345-192.168.206.48@tcp:39:umount.0 00000020:00000080:1.0:1789446158.085058:0:17261:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff374550279 00000100:00080000:1.0:1789446158.085075:0:17261:0:(import.c:65:import_set_state_nolock()) ffff9c2c065df800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789446158.085097:0:17261:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1789446158.085311:0:17261:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e79b41b2-79c3-4831-ae5f-f4f0cf0e5595+3:2403:x1876369773573632:12345-192.168.206.48@tcp:39:umount.0 Request processed in 307us (2529us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789446158.085320:0:17261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 68 00010000:00010000:2.0:1789446158.086593:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789446158.086763:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789446158.310921:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446159.334600:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789446159.560101:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446159.560142:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446159.560219:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446159.560292:0:20289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773573760 00000100:00100000:3.0:1789446159.560310:0:20289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773573760 00000100:00100000:3.0:1789446159.560375:0:20289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773573888 00000100:00100000:3.0:1789446159.560379:0:20289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773573888 00000100:00100000:3.0:1789446159.560394:0:20289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773574016 00000100:00100000:3.0:1789446159.560397:0:20289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773574016 00000100:00100000:3.0:1789446159.560474:0:20289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:3.0:1789446159.560486:0:20289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a65c2231-c3aa-4a28-bbc7-c4cd07dee5d6+12:2404:x1876369773573760:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789446159.560501:0:20289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789446159.560519:0:20289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d36a50000/0x62554ff3745502a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65250 expref: 12 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446159.560537:0:20289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789446159.560583:0:20289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a65c2231-c3aa-4a28-bbc7-c4cd07dee5d6+11:2404:x1876369773573760:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 100us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446159.560590:0:20289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:2.0:1789446159.560615:0:17248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:2.0:1789446159.560626:0:17248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65c2231-c3aa-4a28-bbc7-c4cd07dee5d6+10:2405:x1876369773573888:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789446159.560635:0:17248:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789446159.560645:0:17248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d36a51200/0x62554ff3745502e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a652c0 expref: 10 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446159.560659:0:17248:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789446159.560690:0:17248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65c2231-c3aa-4a28-bbc7-c4cd07dee5d6+9:2405:x1876369773573888:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 67us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446159.561758:0:20289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:3.0:1789446159.561777:0:20289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a65c2231-c3aa-4a28-bbc7-c4cd07dee5d6+9:2407:x1876369773574016:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789446159.561790:0:20289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789446159.561804:0:20289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d36a51600/0x62554ff3745502aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65281 expref: 9 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446159.561816:0:20289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789446159.561844:0:20289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a65c2231-c3aa-4a28-bbc7-c4cd07dee5d6+8:2407:x1876369773574016:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 76us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446159.561850:0:20289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:1.0:1789446159.564859:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446159.565318:0:17263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773574272 00000100:00100000:3.0:1789446159.565327:0:17263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773574272 00000100:00100000:3.0:1789446159.565387:0:17263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:3.0:1789446159.565412:0:17263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e662eab-64e8-474c-9462-3d611ecfc6a7+6:2403:x1876369773574272:12345-192.168.206.48@tcp:39:umount.0 00000020:00000080:3.0:1789446159.565470:0:17263:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff3745502b8 00000020:00010000:3.0:1789446159.565479:0:17263:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c2d41ba4000: total 0 00000100:00080000:3.0:1789446159.565483:0:17263:0:(import.c:65:import_set_state_nolock()) ffff9c2d41ba2800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789446159.565505:0:17263:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:3.0:1789446159.565633:0:17263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e662eab-64e8-474c-9462-3d611ecfc6a7+5:2403:x1876369773574272:12345-192.168.206.48@tcp:39:umount.0 Request processed in 225us (783us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1789446159.565641:0:17263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 69 00000020:00010000:3.0:1789446159.565701:0:17249:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c2d41ba4000: total 0 00010000:00010000:3.0:1789446159.565764:0:17249:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c2d41ba4000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789446159.565795:0:17249:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2d02f24a00) 00010000:00010000:3.0:1789446159.565817:0:17249:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789446159.565859:0:17249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806200/0x62554ff3745503ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a652ea expref: 4 pid: 17263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446159.565900:0:17248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00080000:1.0:1789446159.566042:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789446159.566318:0:17249:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c2d41ba4000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789446159.566335:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446159.566337:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446159.566338:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789446159.573071:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446159.573439:0:17261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773574400 00000100:00100000:1.0:1789446159.573509:0:17261:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773574400 00000100:00100000:1.0:1789446159.573641:0:17261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00100000:1.0:1789446159.573654:0:17261:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c081d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e662eab-64e8-474c-9462-3d611ecfc6a7+5:2403:x1876369773574400:12345-192.168.206.48@tcp:39:umount.0 00000020:00000080:1.0:1789446159.573718:0:17261:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff3745502bf 00000100:00080000:1.0:1789446159.573731:0:17261:0:(import.c:65:import_set_state_nolock()) ffff9c2d112fb000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789446159.573775:0:17261:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1789446159.573984:0:17261:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c081d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e662eab-64e8-474c-9462-3d611ecfc6a7+3:2403:x1876369773574400:12345-192.168.206.48@tcp:39:umount.0 Request processed in 308us (902us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789446159.574012:0:17261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00080000:3.0:1789446159.575309:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789446159.575787:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789446159.599736:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446159.599845:0:17255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773574656 00000100:00100000:3.0:1789446159.599860:0:17255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773574656 00000100:00100000:3.0:1789446159.599940:0:17255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 172 00000100:00100000:3.0:1789446159.599952:0:17255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2eca3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65c2231-c3aa-4a28-bbc7-c4cd07dee5d6+7:2403:x1876369773574656:12345-192.168.206.48@tcp:251:umount.0 00000020:00000080:3.0:1789446159.600192:0:17255:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff374550256 00000020:00010000:3.0:1789446159.600206:0:17255:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c2d35c54800: total 0 00000100:00080000:3.0:1789446159.600212:0:17255:0:(import.c:65:import_set_state_nolock()) ffff9c2d35c56000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789446159.600322:0:17255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2eca3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a65c2231-c3aa-4a28-bbc7-c4cd07dee5d6+3:2403:x1876369773574656:12345-192.168.206.48@tcp:251:umount.0 Request processed in 368us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446159.600332:0:17255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 172 00000020:00010000:0.0:1789446159.601004:0:17250:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c2d35c54800: total 0 00010000:00010000:0.0:1789446159.601092:0:17250:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c2d35c54800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789446159.601139:0:17250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d42158400/0x62554ff37455025d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a651d9 expref: 2 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446159.601159:0:17250:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c2d35c54800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789446159.601171:0:17250:0:(genops.c:885:class_export_put()) final put ffff9c2d35c54800/a65c2231-c3aa-4a28-bbc7-c4cd07dee5d6 00010000:00010000:0.0:1789446159.601194:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446159.601197:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446159.601198:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789446159.602747:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d35c54800/a65c2231-c3aa-4a28-bbc7-c4cd07dee5d6 for MGS 00000020:00000080:3.0:1789446159.602797:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d35c56000 for MGS 00010000:00010000:3.0:1789446160.358287:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446160.615614:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794620288:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789446160.615729:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446160.615893:0:18769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794620288 00000100:00100000:0.0:1789446160.615902:0:18769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794620288 00000100:00100000:0.0:1789446160.615986:0:18769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789446160.615998:0:18769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d35cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794620288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789446160.616035:0:18769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789446160.616088:0:18769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d35cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794620288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446160.616095:0:18769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1789446160.616123:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789446160.616164:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794620288:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1789446161.064428:0:18013:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789446161.126203:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789446161.126234:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1876369794620416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789446161.126324:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446161.126407:0:17267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794620416 00000100:00100000:0.0:1789446161.126416:0:17267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794620416 00000100:00100000:0.0:1789446161.126475:0:17267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789446161.126484:0:17267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d369d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1876369794620416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789446161.126526:0:17267:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789446161.126596:0:17267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d369d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1876369794620416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446161.126604:0:17267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789446161.127303:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789446161.127316:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c081d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794620544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789446161.127360:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446161.127504:0:17266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794620544 00000100:00100000:3.0:1789446161.127511:0:17266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794620544 00000100:00100000:3.0:1789446161.127559:0:17266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789446161.127568:0:17266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794620544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789446161.127617:0:17266:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1789446161.127885:0:17266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794620544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 316us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446161.127893:0:17266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789446161.127943:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c081d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794620544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789446161.128078:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1876369794620416:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789446161.382107:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789446161.426906:0:20835:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789446161.438203:0:20835:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789446161.438280:0:20835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36807200/0x62554ff37454fe19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff37454fe20 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446161.438319:0:20835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36807200/0x62554ff37454fe19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff37454fe20 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446161.438328:0:20835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36807200/0x62554ff37454fe19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff37454fe20 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446161.438336:0:20835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9c2d36807200/0x62554ff37454fe19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff37454fe20 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446161.438493:0:20835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789446161.438499:0:20835:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789446161.438541:0:20835:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789446161.438546:0:20835:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789446161.438553:0:20835:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789446161.438583:0:20835:0:(import.c:65:import_set_state_nolock()) ffff9c2d102a5000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789446161.440149:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1876369794620672:0@lo:39:umount.0 00000100:00100000:1.0:1789446161.440250:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446161.440487:0:17263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794620672 00000100:00100000:1.0:1789446161.440498:0:17263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794620672 00000100:00100000:1.0:1789446161.440560:0:17263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789446161.440571:0:17263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1876369794620672:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789446161.440607:0:17263:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fe4a 00000100:00080000:1.0:1789446161.440618:0:17263:0:(import.c:65:import_set_state_nolock()) ffff9c2d3fe3b800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789446161.445183:0:17250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446161.445203:0:17250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d36807200/0x62554ff37454fe19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff37454fe20 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.445231:0:17250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36807200 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:0.0:1789446161.445236:0:17250:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d36807200/0x62554ff37454fe19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff37454fe20 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.445248:0:17250:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d36807200/0x62554ff37454fe19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x62554ff37454fe20 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789446161.445256:0:17250:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d36807200/0x62554ff37454fe19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x62554ff37454fe20 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446161.445262:0:17250:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789446161.445265:0:17250:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789446161.445269:0:17250:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789446161.445317:0:17250:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9c2d36807200/0x62554ff37454fe19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff37454fe20 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.445323:0:17250:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789446161.445359:0:17250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d36807200/0x62554ff37454fe19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff37454fe20 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.445367:0:17250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d36807200/0x62554ff37454fe19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff37454fe20 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.445383:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446161.445385:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446161.445387:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446161.446163:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789446161.446194:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3658:1876369794620800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789446161.446280:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446161.447208:0:20289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794620800 00000100:00100000:2.0:1789446161.447225:0:20289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794620800 00000100:00100000:2.0:1789446161.447310:0:20289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789446161.447322:0:20289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d37c19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c2066a7-cdc1-4793-80dc-4607cc2d2086+24:3658:x1876369794620800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789446161.447340:0:20289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789446161.447363:0:20289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d36807600/0x62554ff37454fe20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x62554ff37454fe19 expref: 24 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446161.447386:0:20289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789446161.447944:0:20289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d37c19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c2066a7-cdc1-4793-80dc-4607cc2d2086+23:3658:x1876369794620800:12345-0@lo:103:ldlm_bl.0 Request processed in 621us (1661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446161.447953:0:20289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789446161.448193:0:17263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3656:x1876369794620672:12345-0@lo:39:umount.0 Request processed in 7623us (7942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446161.448203:0:17263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:1.0:1789446161.448228:0:17263:0:(genops.c:885:class_export_put()) final put ffff9c2d3fe3b000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1789446161.448283:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d102a5000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789446161.448294:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1876369794620672:0@lo:39:umount.0 00010000:00010000:2.0:1789446161.448482:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789446161.448496:0:20835:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789446161.448501:0:20835:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789446161.448507:0:20835:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1789446161.449577:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3658:1876369794620800:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1789446161.450363:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3fe3b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:2.0:1789446161.451043:0:20835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c200/0x62554ff37454fd6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff37454fd71 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446161.451062:0:20835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c200/0x62554ff37454fd6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff37454fd71 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789446161.451240:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d3fe3b800 for lustre-MDT0000 00010000:00010000:2.0:1789446161.451581:0:20835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c200/0x62554ff37454fd6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff37454fd71 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446161.451591:0:20835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c200/0x62554ff37454fd6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff37454fd71 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446161.451654:0:20835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789446161.451673:0:20835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9d800/0x62554ff3745500b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745500b9 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446161.451680:0:20835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9d800/0x62554ff3745500b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff3745500b9 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446161.451686:0:20835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9d800/0x62554ff3745500b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff3745500b9 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446161.451693:0:20835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9d800/0x62554ff3745500b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff3745500b9 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.451755:0:19710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789446161.451764:0:19710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c200/0x62554ff37454fd6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff37454fd71 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.451773:0:19710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9c200 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:0.0:1789446161.451778:0:19710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c200/0x62554ff37454fd6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff37454fd71 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.451788:0:19710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c200/0x62554ff37454fd6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x62554ff37454fd71 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789446161.451796:0:19710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c200/0x62554ff37454fd6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x62554ff37454fd71 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446161.451802:0:19710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789446161.451805:0:19710:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1789446161.451851:0:19710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c200/0x62554ff37454fd6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff37454fd71 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.451858:0:19710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789446161.451897:0:19710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c200/0x62554ff37454fd6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff37454fd71 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.451905:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c200/0x62554ff37454fd6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff37454fd71 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.451922:0:19710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446161.451925:0:19710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9d800/0x62554ff3745500b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff3745500b9 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.451953:0:19710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9d800 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:0.0:1789446161.451983:0:19710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9d800/0x62554ff3745500b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff3745500b9 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.451992:0:19710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9d800/0x62554ff3745500b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x62554ff3745500b9 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789446161.451998:0:19710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9d800/0x62554ff3745500b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x62554ff3745500b9 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446161.452004:0:19710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789446161.452006:0:19710:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1789446161.452023:0:19710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9d800/0x62554ff3745500b2 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff3745500b9 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.452029:0:19710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789446161.452047:0:19710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9d800/0x62554ff3745500b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff3745500b9 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.452055:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446161.452057:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446161.452059:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446161.452080:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789446161.452103:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d37c0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3660:1876369794621056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789446161.452188:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446161.452252:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794621056 00000100:00100000:0.0:1789446161.452261:0:17247:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794621056 00000100:00100000:0.0:1789446161.452316:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789446161.452327:0:17247:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d37c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c2066a7-cdc1-4793-80dc-4607cc2d2086+23:3660:x1876369794621056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789446161.452351:0:17247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789446161.452369:0:17247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d2fa9c800/0x62554ff3745500b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x62554ff3745500b2 expref: 23 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.452384:0:17247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789446161.452584:0:17247:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d37c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c2066a7-cdc1-4793-80dc-4607cc2d2086+22:3660:x1876369794621056:12345-0@lo:103:ldlm_bl.0 Request processed in 257us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446161.452592:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789446161.452644:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d37c0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3660:1876369794621056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789446161.452739:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3658:1876369794620928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789446161.452774:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446161.452848:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794620928 00000100:00100000:0.0:1789446161.452853:0:17246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794620928 00000100:00100000:0.0:1789446161.452893:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789446161.452901:0:17246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3fee8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c2066a7-cdc1-4793-80dc-4607cc2d2086+22:3658:x1876369794620928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789446161.452909:0:17246:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789446161.452921:0:17246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d13ba7a00/0x62554ff37454fd71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x62554ff37454fd6a expref: 22 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.452933:0:17246:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789446161.452978:0:17246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3fee8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c2066a7-cdc1-4793-80dc-4607cc2d2086+21:3658:x1876369794620928:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446161.452984:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789446161.453210:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3658:1876369794620928:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789446161.453320:0:20835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789446161.453341:0:20835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9d800/0x62554ff3745500b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff3745500b9 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789446161.453354:0:20835:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789446161.453364:0:20835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d42159a00/0x62554ff374550321 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550328 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446161.453373:0:20835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d42159a00/0x62554ff374550321 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff374550328 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446161.453380:0:20835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d42159a00/0x62554ff374550321 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff374550328 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446161.453387:0:20835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9c2d42159a00/0x62554ff374550321 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff374550328 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.453495:0:17250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446161.453502:0:17250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d42159a00/0x62554ff374550321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff374550328 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.453510:0:17250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d42159a00 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:0.0:1789446161.453514:0:17250:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d42159a00/0x62554ff374550321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff374550328 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.453531:0:17250:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d42159a00/0x62554ff374550321 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x62554ff374550328 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789446161.453538:0:17250:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d42159a00/0x62554ff374550321 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x62554ff374550328 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446161.453543:0:17250:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789446161.453545:0:17250:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1789446161.453567:0:17250:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9c2d42159a00/0x62554ff374550321 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff374550328 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.453578:0:17250:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789446161.453622:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d37c0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3660:1876369794621184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789446161.453656:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446161.453735:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794621184 00000100:00100000:3.0:1789446161.453742:0:17247:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794621184 00000100:00100000:3.0:1789446161.453781:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789446161.453789:0:17247:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c2066a7-cdc1-4793-80dc-4607cc2d2086+21:3660:x1876369794621184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789446161.453798:0:17247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789446161.453811:0:17247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d36a51000/0x62554ff374550328 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x62554ff374550321 expref: 21 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446161.453821:0:17247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789446161.453866:0:17250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d42159a00/0x62554ff374550321 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff374550328 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.453876:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446161.453878:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446161.453880:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446161.453920:0:20835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789446161.453925:0:20835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d42159a00/0x62554ff374550321 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff374550328 expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789446161.453937:0:20835:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789446161.453944:0:20835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9de00/0x62554ff37454fd5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff37454fd63 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446161.453951:0:20835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9de00/0x62554ff37454fd5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff37454fd63 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446161.453980:0:20835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9de00/0x62554ff37454fd5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff37454fd63 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446161.453986:0:20835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9de00/0x62554ff37454fd5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff37454fd63 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446161.454004:0:20835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789446161.454007:0:20835:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1789446161.454010:0:20835:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789446161.454062:0:20835:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789446161.454066:0:20835:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789446161.454071:0:20835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789446161.454078:0:20835:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1789446161.454083:0:20835:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2c0756d000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789446161.454088:0:20835:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2d2f979000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789446161.454092:0:20835:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2d2f97c000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789446161.454097:0:20835:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2d2fb02800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789446161.454106:0:20835:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9c2d41ba4000 9e662eab-64e8-474c-9462-3d611ecfc6a7 192.168.206.48@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:2.0:1789446161.454111:0:20835:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9c2c06780000 e79b41b2-79c3-4831-ae5f-f4f0cf0e5595 192.168.206.48@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:2.0:1789446161.454117:0:20835:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9c2d369899c0) has exports, disconnecting them 00000020:00080000:2.0:1789446161.454121:0:20835:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2c0756d000), last request at 1789446156 00000020:00000080:2.0:1789446161.454129:0:20835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff374550081 00000100:00080000:2.0:1789446161.454148:0:20835:0:(import.c:65:import_set_state_nolock()) ffff9c2d180ba000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789446161.454204:0:20835:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2c0756d000): rc 0 00000020:00000080:2.0:1789446161.454206:0:20835:0:(genops.c:885:class_export_put()) final put ffff9c2c0756d000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789446161.454215:0:20835:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2d2f979000), last request at 1789446156 00000020:00000080:2.0:1789446161.454218:0:20835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454ffe7 00000100:00080000:2.0:1789446161.454223:0:20835:0:(import.c:65:import_set_state_nolock()) ffff9c2d2f97f800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789446161.454230:0:20835:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2d2f979000): rc 0 00000020:00000080:2.0:1789446161.454232:0:20835:0:(genops.c:885:class_export_put()) final put ffff9c2d2f979000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1789446161.454236:0:20835:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2d2f97c000), last request at 1789446089 00000020:00000080:2.0:1789446161.454247:0:20835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454ff38 00000100:00080000:2.0:1789446161.454251:0:20835:0:(import.c:65:import_set_state_nolock()) ffff9c2d2f97e800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789446161.454258:0:20835:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2d2f97c000): rc 0 00000020:00000080:2.0:1789446161.454260:0:20835:0:(genops.c:885:class_export_put()) final put ffff9c2d2f97c000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1789446161.454265:0:20835:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2d2fb02800), last request at 1789446089 00000020:00000080:2.0:1789446161.454268:0:20835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fecf 00000100:00080000:2.0:1789446161.454272:0:20835:0:(import.c:65:import_set_state_nolock()) ffff9c2d2fb05800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789446161.454278:0:20835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:2.0:1789446161.454359:0:20835:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2d2fb02800): rc 0 00000004:00000080:2.0:1789446161.454366:0:20835:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffae10819afae0 00000100:00080000:2.0:1789446161.454388:0:20835:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789446161.454392:0:20835:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789446161.455358:0:20835:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789446161.455395:0:20835:0:(import.c:65:import_set_state_nolock()) ffff9c2d35d00000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1789446161.455599:0:17249:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446161.455609:0:17249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9de00/0x62554ff37454fd5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff37454fd63 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.455620:0:17249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9de00 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:0.0:1789446161.455625:0:17249:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9de00/0x62554ff37454fd5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff37454fd63 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.455636:0:17249:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9de00/0x62554ff37454fd5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x62554ff37454fd63 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789446161.455644:0:17249:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9de00/0x62554ff37454fd5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x62554ff37454fd63 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446161.455677:0:17249:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789446161.455680:0:17249:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789446161.455684:0:17249:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789446161.455718:0:17249:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9de00/0x62554ff37454fd5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff37454fd63 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.455724:0:17249:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789446161.455756:0:17249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9de00/0x62554ff37454fd5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff37454fd63 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.455764:0:17249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9de00/0x62554ff37454fd5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff37454fd63 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.455781:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446161.455783:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446161.455785:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789446161.455799:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c0756d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789446161.455862:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d2f979000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789446161.455886:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d2f97c000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789446161.455909:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d180ba000 for lustre-MDT0000 00000020:00000080:0.0:1789446161.455914:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d2f97f800 for lustre-MDT0000 00000020:00000080:0.0:1789446161.455919:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d2f97e800 for lustre-MDT0000 00010000:00010000:0.0:1789446161.456036:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446161.456043:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446161.457841:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794621312:0@lo:39:umount.0 00000100:00100000:0.0:1789446161.457947:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446161.458050:0:18001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794621312 00000100:00100000:0.0:1789446161.458061:0:18001:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794621312 00000100:00100000:0.0:1789446161.458144:0:18001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789446161.458154:0:18001:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d37c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1876369794621312:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789446161.458195:0:18001:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454ff62 00000100:00080000:0.0:1789446161.458207:0:18001:0:(import.c:65:import_set_state_nolock()) ffff9c2d3fe94000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789446161.458236:0:18001:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1789446161.458424:0:18001:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d37c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3656:x1876369794621312:12345-0@lo:39:umount.0 Request processed in 271us (477us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789446161.458432:0:18001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00010000:0.0:1789446161.458463:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789446161.458496:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d35d00000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789446161.458505:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794621312:0@lo:39:umount.0 00000100:00100000:2.0:1789446161.458778:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d37c0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3657:1876369794621440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789446161.458828:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789446161.458948:0:20835:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789446161.458952:0:20835:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1789446161.458989:0:20835:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789446161.459061:0:20835:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789446161.459084:0:20835:0:(import.c:65:import_set_state_nolock()) ffff9c2c05a58800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789446161.459097:0:20835:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789446161.459099:0:20835:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1789446161.459116:0:20835:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789446161.459176:0:20835:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789446161.459185:0:20835:0:(import.c:65:import_set_state_nolock()) ffff9c2d3d06e800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789446161.459231:0:20835:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9c2d369899c0) has no exports 00000100:00100000:0.0:1789446161.459464:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794621440 00000100:00100000:0.0:1789446161.459472:0:17246:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794621440 00000100:00100000:0.0:1789446161.459523:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789446161.459532:0:17246:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c2066a7-cdc1-4793-80dc-4607cc2d2086+21:3657:x1876369794621440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789446161.459548:0:17246:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789446161.459571:0:17246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d13ba6e00/0x62554ff37454fd63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x62554ff37454fd5c expref: 21 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446161.459591:0:17246:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789446161.459640:0:17246:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c2066a7-cdc1-4793-80dc-4607cc2d2086+20:3657:x1876369794621440:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446161.459647:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789446161.459697:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d37c0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3657:1876369794621440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789446161.459723:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794621568:0@lo:9:umount.0 00000100:00100000:0.0:1789446161.459756:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446161.459799:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794621696:0@lo:9:umount.0 00000100:00100000:0.0:1789446161.459823:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446161.459853:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794621568 00000100:00100000:0.0:1789446161.459857:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794621568 00000100:00100000:0.0:1789446161.459896:0:19357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794621696 00000100:00100000:0.0:1789446161.459899:0:19357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794621696 00000100:00100000:0.0:1789446161.459923:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789446161.459930:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d37c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1876369794621568:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789446161.459978:0:19357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff3745500c0 00000100:00080000:0.0:1789446161.459989:0:19357:0:(import.c:65:import_set_state_nolock()) ffff9c2c05bce800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789446161.460040:0:19357:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1789446161.460177:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d37c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3656:x1876369794621568:12345-0@lo:9:umount.0 Request processed in 248us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446161.460184:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789446161.460197:0:19357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789446161.460202:0:19357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d37c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3656:x1876369794621696:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789446161.460215:0:19357:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff3745500c7 00000100:00080000:0.0:1789446161.460221:0:19357:0:(import.c:65:import_set_state_nolock()) ffff9c2c05bce000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789446161.460243:0:19357:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1789446161.460308:0:19357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d37c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3656:x1876369794621696:12345-0@lo:9:umount.0 Request processed in 106us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446161.460315:0:19357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1789446161.460335:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789446161.460338:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789446161.460355:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446161.460361:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789446161.460381:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2c05a58800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789446161.460388:0:3656:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789446161.460398:0:3656:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789446161.460402:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794621568:0@lo:9:umount.0 00000100:00080000:0.0:1789446161.460414:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d3d06e800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789446161.460418:0:3656:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789446161.460419:0:3656:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789446161.460421:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794621696:0@lo:9:umount.0 00000100:00100000:3.0:1789446161.461464:0:17247:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c2066a7-cdc1-4793-80dc-4607cc2d2086+19:3660:x1876369794621184:12345-0@lo:103:ldlm_bl.0 Request processed in 7670us (7801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446161.461488:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789446161.462388:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d37c0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3660:1876369794621184:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1789446161.468614:0:20835:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9c2d369899c0) has no exports 00000020:00000080:2.0:1789446161.533829:0:20835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fdb7 00000020:00000080:2.0:1789446161.533845:0:20835:0:(genops.c:885:class_export_put()) final put ffff9c2d3fea6800/lustre-QMT0000_UUID 00000020:01000000:2.0:1789446161.533911:0:20835:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1789446161.534055:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3fea6800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1789446161.534081:0:20835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789446161.534090:0:20835:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789446161.534095:0:20835:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9c2c06b23380) has no exports 00000020:00000080:3.0:1789446161.534433:0:20835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fdb0 00000020:00000080:3.0:1789446161.534439:0:20835:0:(genops.c:885:class_export_put()) final put ffff9c2d1845a800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789446161.534496:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d1845a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789446161.534563:0:20835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789446161.534571:0:20835:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789446161.534573:0:20835:0:(genops.c:885:class_export_put()) final put ffff9c2d102a1000/lustre-QMT0000_UUID 00000020:00000080:3.0:1789446161.534576:0:20835:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d102a1000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1789446161.534580:0:20835:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:1.0:1789446161.638725:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794621824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789446161.638847:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446161.638972:0:18769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794621824 00000100:00100000:3.0:1789446161.638984:0:18769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794621824 00000100:00100000:3.0:1789446161.639060:0:18769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789446161.639072:0:18769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794621824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789446161.639102:0:18769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00080000:1.0:1789446161.639148:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789446161.639189:0:18769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794621824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446161.639197:0:18769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789446161.639233:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794621824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789446161.639708:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d37c0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794621952:0@lo:400:kworker.0 00000100:00100000:1.0:1789446161.639721:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2a235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1876369794622336:0@lo:400:kworker.0 00000100:00100000:3.0:1789446161.639754:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446161.639772:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d37c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1876369794622080:0@lo:400:kworker.0 00000100:00100000:1.0:1789446161.639785:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446161.639798:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2a234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1876369794622464:0@lo:400:kworker.0 00000100:00100000:1.0:1789446161.639829:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789446161.639838:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446161.639844:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2a235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1876369794622208:0@lo:400:kworker.0 00000100:00100000:3.0:1789446161.639857:0:17261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794622336 00000100:00100000:3.0:1789446161.639864:0:17261:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794622336 00000100:00100000:0.0:1789446161.639875:0:17262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794622080 00000100:00100000:0.0:1789446161.639878:0:17262:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794622080 00000100:00100000:1.0:1789446161.639891:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789446161.639952:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789446161.640023:0:19708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794621952 00000100:00100000:1.0:1789446161.640029:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446161.640031:0:19708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794621952 00000100:00100000:2.0:1789446161.640074:0:19708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789446161.640081:0:19708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c081d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794621952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446161.640126:0:19708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c081d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794621952:12345-0@lo:400:kworker.0 Request processed in 46us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446161.640133:0:19708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789446161.643643:0:17262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794622208 00000100:00100000:0.0:1789446161.643669:0:17262:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794622208 00000100:00100000:0.0:1789446161.643710:0:17262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794622464 00000100:00100000:0.0:1789446161.643713:0:17262:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794622464 00000100:00100000:0.0:1789446161.643727:0:17262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789446161.643742:0:17262:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1876369794622336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446161.643850:0:17262:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1876369794622336:12345-0@lo:400:kworker.0 Request processed in 115us (4067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446161.643857:0:17262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789446161.643877:0:17262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789446161.643881:0:17262:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3660:x1876369794622080:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789446161.643887:0:17262:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789446161.644168:0:17262:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3660:x1876369794622080:12345-0@lo:400:kworker.0 Request processed in 31us (4079us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789446161.644175:0:17262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789446161.644191:0:17262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789446161.644195:0:17262:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1876369794622208:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789446161.644211:0:17262:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789446161.644236:0:17262:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1876369794622208:12345-0@lo:400:kworker.0 Request processed in 40us (4347us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789446161.644241:0:17262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789446161.644251:0:17262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789446161.644255:0:17262:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3659:x1876369794622464:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789446161.644259:0:17262:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789446161.644278:0:17262:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3659:x1876369794622464:12345-0@lo:400:kworker.0 Request processed in 23us (4255us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789446161.644283:0:17262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1789446161.644343:0:3660:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789446161.644348:0:3660:0:(import.c:65:import_set_state_nolock()) ffff9c2d2f97f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789446161.644351:0:3660:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789446161.645832:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789446161.645840:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9c2c079a1800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789446161.645845:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789446161.645851:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9c2c079a1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789446161.645856:0:3659:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 500 00000100:00080000:1.0:1789446161.645872:0:3659:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2c079a1800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1789446161.645919:0:3659:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2d3edcc000 x1876369794622720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789446161.645978:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2a234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1876369794622464:0@lo:400:kworker.0 00000100:00100000:1.0:1789446161.646002:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d37c0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794621952:0@lo:400:kworker.0 00000100:00080000:1.0:1789446161.646068:0:3658:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789446161.646071:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9c2d31d3c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789446161.646075:0:3658:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789446161.646095:0:3658:0:(import.c:65:import_set_state_nolock()) ffff9c2d31d3c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789446161.646099:0:3658:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 486 00000100:00080000:1.0:1789446161.646105:0:3658:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2d31d3c000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1789446161.646120:0:3658:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2d3edcd500 x1876369794622848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789446161.646132:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2a235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1876369794622208:0@lo:400:kworker.0 00010000:00080000:1.0:1789446161.646149:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2d2a235f80 x1876369794622336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789446161.646158:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2a235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1876369794622336:0@lo:400:kworker.0 00000100:00100000:1.0:1789446161.646207:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1876369794622720:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789446161.646273:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446161.647598:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1876369794622848:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789446161.647675:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446161.647741:0:20169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794622720 00000100:00100000:1.0:1789446161.647751:0:20169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794622720 00000100:00100000:1.0:1789446161.647786:0:20169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794622848 00000100:00100000:1.0:1789446161.647789:0:20169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794622848 00000100:00100000:1.0:1789446161.647804:0:20169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789446161.647813:0:20169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d37c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1876369794622720:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1789446161.647836:0:20169:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789446161.648772:0:17261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789446161.648784:0:17261:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1876369794622848:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1789446161.648822:0:17261:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789446161.648910:0:17261:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1876369794622848:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 126us (1234us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789446161.648918:0:17261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1789446161.649025:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d31d3c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789446161.649030:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789446161.649034:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1876369794622848:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1789446161.656573:0:3660:0:(import.c:65:import_set_state_nolock()) ffff9c2d2f97f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789446161.656582:0:3660:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 471 00000100:00080000:0.0:1789446161.656597:0:3660:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2d2f97f000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789446161.656635:0:3660:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2d2a235f80 x1876369794622976/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789446161.656676:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d37c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1876369794622080:0@lo:400:kworker.0 00000100:00100000:0.0:1789446161.656687:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2a235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1876369794622592:0@lo:400:kworker.0 00000100:00100000:0.0:1789446161.656747:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446161.657437:0:17261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794622592 00000100:00100000:2.0:1789446161.657447:0:17261:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794622592 00000100:00100000:2.0:1789446161.657521:0:17261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789446161.657531:0:17261:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1876369794622592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446161.657585:0:17261:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1876369794622592:12345-0@lo:400:kworker.0 Request processed in 56us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446161.657593:0:17261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1789446161.657673:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789446161.657700:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2d2a235c00 x1876369794622592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446161.657711:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2a235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1876369794622592:0@lo:400:kworker.0 00000100:00100000:3.0:1789446161.658176:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2a235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1876369794622976:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1789446161.658213:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446161.658296:0:17263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794622976 00000100:00100000:2.0:1789446161.658301:0:17263:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794622976 00000100:00100000:2.0:1789446161.658330:0:17263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789446161.658336:0:17263:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c081d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1876369794622976:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1789446161.658349:0:17263:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789446161.658391:0:17263:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c081d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1876369794622976:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 55us (178us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789446161.658396:0:17263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1789446161.658506:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d2f97f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789446161.658511:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789446161.658514:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2a235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1876369794622976:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789446161.672266:0:20169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d37c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1876369794622720:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 24445us (25985us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789446161.672282:0:20169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1789446161.672473:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2c079a1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789446161.672480:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789446161.672484:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1876369794622720:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:0.0:1789446162.411638:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446163.433446:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789446163.688560:0:19580:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789446163.688568:0:19580:0:(genops.c:885:class_export_put()) final put ffff9c2c05bcd800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789446163.688596:0:19580:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e79b41b2-79c3-4831-ae5f-f4f0cf0e5595 00000020:00000080:3.0:1789446163.688599:0:19580:0:(genops.c:885:class_export_put()) final put ffff9c2c065de000/e79b41b2-79c3-4831-ae5f-f4f0cf0e5595 00000020:00000080:0.0:1789446163.688668:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c05bcd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789446163.688721:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c065de000/e79b41b2-79c3-4831-ae5f-f4f0cf0e5595 for lustre-OST0001 00000020:00000080:0.0:1789446163.688742:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2c05bce000 for lustre-OST0001 00000020:00000080:0.0:1789446163.688748:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2c065da800 for lustre-OST0001 00000001:00100000:1.0:1789446163.702898:0:17992:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789446163.702914:0:17992:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1789446163.702930:0:17992:0:(genops.c:885:class_export_put()) final put ffff9c2d3fe23800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789446163.703014:0:17992:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9e662eab-64e8-474c-9462-3d611ecfc6a7 00000001:00080000:1.0:1789446163.703022:0:17992:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1789446163.703024:0:17992:0:(genops.c:885:class_export_put()) final put ffff9c2d3d068800/9e662eab-64e8-474c-9462-3d611ecfc6a7 00000001:00100000:1.0:1789446163.703030:0:17992:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e79b41b2-79c3-4831-ae5f-f4f0cf0e5595 00000001:00080000:1.0:1789446163.703034:0:17992:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1789446163.703036:0:17992:0:(genops.c:885:class_export_put()) final put ffff9c2c065da000/e79b41b2-79c3-4831-ae5f-f4f0cf0e5595 00000001:00100000:0.0:1789446163.703121:0:17241:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789446163.703125:0:17241:0:(genops.c:885:class_export_put()) final put ffff9c2d2fb02800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789446163.703135:0:17241:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9e662eab-64e8-474c-9462-3d611ecfc6a7 00000001:00080000:0.0:1789446163.703140:0:17241:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:0.0:1789446163.703142:0:17241:0:(genops.c:885:class_export_put()) final put ffff9c2d41ba4000/9e662eab-64e8-474c-9462-3d611ecfc6a7 00000001:00100000:0.0:1789446163.703149:0:17241:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e79b41b2-79c3-4831-ae5f-f4f0cf0e5595 00000001:00080000:0.0:1789446163.703154:0:17241:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:0.0:1789446163.703161:0:17241:0:(genops.c:885:class_export_put()) final put ffff9c2c06780000/e79b41b2-79c3-4831-ae5f-f4f0cf0e5595 00000020:00000080:3.0:1789446163.703556:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3fe23800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1789446163.703625:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3d068800/9e662eab-64e8-474c-9462-3d611ecfc6a7 for lustre-MDT0001 00000020:00000080:3.0:1789446163.703656:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c065da000/e79b41b2-79c3-4831-ae5f-f4f0cf0e5595 for lustre-MDT0001 00000020:00000080:3.0:1789446163.703686:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d2fb02800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1789446163.703706:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d41ba4000/9e662eab-64e8-474c-9462-3d611ecfc6a7 for lustre-MDT0000 00000020:00000080:3.0:1789446163.703730:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c06780000/e79b41b2-79c3-4831-ae5f-f4f0cf0e5595 for lustre-MDT0000 00000020:00000080:3.0:1789446163.703752:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d3fe94000 for lustre-MDT0001 00000020:00000080:3.0:1789446163.703755:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d112fb000 for lustre-MDT0001 00000020:00000080:3.0:1789446163.703758:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2c065df800 for lustre-MDT0001 00000020:00000080:3.0:1789446163.703770:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d2fb05800 for lustre-MDT0000 00000020:00000080:3.0:1789446163.703773:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d41ba2800 for lustre-MDT0000 00000020:00000080:3.0:1789446163.703775:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d187ae800 for lustre-MDT0000 00010000:00010000:0.0:1789446164.454399:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446165.478348:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446165.744101:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794623104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789446165.744163:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446165.744272:0:18769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794623104 00000100:00100000:3.0:1789446165.744280:0:18769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794623104 00000100:00100000:3.0:1789446165.744347:0:18769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789446165.744357:0:18769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794623104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789446165.744384:0:18769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789446165.744440:0:18769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794623104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446165.744448:0:18769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1789446165.744589:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789446165.744608:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794623104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789446166.246195:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789446166.246218:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794623232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789446166.246303:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446166.247444:0:17266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794623232 00000100:00100000:3.0:1789446166.247455:0:17266:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794623232 00000100:00100000:3.0:1789446166.247507:0:17266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789446166.247515:0:17266:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3657:x1876369794623232:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1789446166.247523:0:17266:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789446166.247589:0:17266:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3657:x1876369794623232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (1285us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789446166.247595:0:17266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:02020000:2.0:1789446166.247694:0:3657:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1789446166.263260:0:3657:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789446166.263423:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9c2d205f9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789446166.263429:0:3657:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789446166.280448:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9c2d205f9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789446166.280460:0:3657:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 471 00000100:00080000:2.0:1789446166.280538:0:3657:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2d205f9800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1789446166.280608:0:3657:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2d41b7ea00 x1876369794623360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789446166.280691:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794623360:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789446166.280752:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446166.280860:0:17267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794623360 00000100:00100000:1.0:1789446166.280869:0:17267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794623360 00000100:00100000:1.0:1789446166.280902:0:17267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789446166.280910:0:17267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3656:x1876369794623360:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1789446166.280924:0:17267:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789446166.286909:0:17267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3656:x1876369794623360:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 5990us (6147us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789446166.286924:0:17267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1789446166.291090:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d205f9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789446166.291103:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789446166.291109:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794623360:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1789446166.504121:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446166.758554:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789446166.758577:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1876369794623488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789446166.758660:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789446166.758704:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789446166.758711:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1789446166.758711:0:18769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794623488 00000100:00080000:3.0:1789446166.758716:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c2d2f97f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1789446166.758721:0:18769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794623488 00000100:00080000:3.0:1789446166.758732:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 543 00000100:00080000:3.0:1789446166.758738:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789446166.758748:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2d2f97f000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789446166.758772:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2d08191f80 x1876369794623872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789446166.758779:0:18769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789446166.758792:0:18769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876369794623488:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789446166.758799:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789446166.758804:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789446166.758807:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c2d31d3c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789446166.758812:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 543 00000100:00080000:3.0:1789446166.758816:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00002000:00000024:0.0:1789446166.758821:0:18769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00080000:3.0:1789446166.758822:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2d31d3c000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789446166.758840:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2d08193100 x1876369794624000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789446166.758848:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:3.0:1789446166.758861:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1789446166.758863:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794623744:0@lo:400:kworker.0 00000100:00080000:3.0:1789446166.758869:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1789446166.758873:0:18769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876369794623488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (211us total) trans 0 rc 0/0 00000100:00080000:3.0:1789446166.758874:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c2c079a1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789446166.758883:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 543 00000100:00100000:0.0:1789446166.758886:0:18769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1789446166.758890:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789446166.758900:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2c079a1800 using connection 192.168.206.148@tcp/0@lo 00000100:00080000:0.0:1789446166.758912:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789446166.758913:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446166.758916:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2d08192300 x1876369794624256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789446166.758952:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1876369794623872:0@lo:38:kworker.0 00000100:00100000:0.0:1789446166.759011:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1876369794623488:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789446166.759014:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446166.759037:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3660:1876369794623616:0@lo:400:kworker.0 00000100:00100000:3.0:1789446166.759042:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1876369794624000:0@lo:38:kworker.0 00000100:00100000:0.0:1789446166.759080:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446166.759159:0:17262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794623872 00000100:00100000:2.0:1789446166.759164:0:17262:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794623872 00000100:00100000:2.0:1789446166.759189:0:17262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789446166.759196:0:17262:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1876369794623872:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1789446166.759208:0:17262:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789446166.759311:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446166.759330:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1876369794624256:0@lo:38:kworker.0 00000100:00100000:3.0:1789446166.759352:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446166.759380:0:17255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794623616 00000100:00100000:3.0:1789446166.759384:0:17255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794623616 00000100:00100000:3.0:1789446166.759413:0:17255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789446166.759420:0:17255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2eca1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c2066a7-cdc1-4793-80dc-4607cc2d2086+19:3660:x1876369794623616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446166.759451:0:17255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2eca1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c2066a7-cdc1-4793-80dc-4607cc2d2086+19:3660:x1876369794623616:12345-0@lo:400:kworker.0 Request processed in 32us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446166.759457:0:17255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789446166.759515:0:17261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794624000 00000100:00100000:3.0:1789446166.759519:0:17261:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794624000 00000100:00100000:3.0:1789446166.759532:0:17261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794624256 00000100:00100000:3.0:1789446166.759534:0:17261:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794624256 00000100:00100000:3.0:1789446166.759544:0:17261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789446166.759549:0:17261:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1876369794624000:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1789446166.759558:0:17261:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789446166.759592:0:17261:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1876369794624000:12345-0@lo:38:kworker.0 Request processed in 41us (280us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789446166.759598:0:17261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789446166.759611:0:17261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789446166.759615:0:17261:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1876369794624256:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1789446166.759622:0:17261:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789446166.759666:0:17261:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1876369794624256:12345-0@lo:38:kworker.0 Request processed in 49us (312us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789446166.759672:0:17261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1789446166.759699:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d31d3c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789446166.759710:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789446166.759713:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1876369794624000:0@lo:38:kworker.0 00000100:00080000:3.0:1789446166.759725:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2c079a1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789446166.759729:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789446166.759732:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1876369794624256:0@lo:38:kworker.0 00000100:00100000:3.0:1789446166.759771:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789446166.759780:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08190380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1876369794624128:0@lo:400:kworker.0 00000100:00100000:3.0:1789446166.759806:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446166.759826:0:17261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794624128 00000100:00100000:3.0:1789446166.759829:0:17261:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794624128 00000100:00100000:3.0:1789446166.759857:0:17261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789446166.759863:0:17261:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1876369794624128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446166.759894:0:17261:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1876369794624128:12345-0@lo:400:kworker.0 Request processed in 31us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446166.759900:0:17261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:3.0:1789446166.759928:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2d08190380 x1876369794624128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789446166.759939:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08190380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1876369794624128:0@lo:400:kworker.0 00000100:00100000:3.0:1789446166.760005:0:18767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794623744 00000100:00100000:3.0:1789446166.760009:0:18767:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794623744 00000100:00100000:3.0:1789446166.760037:0:18767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789446166.760044:0:18767:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794623744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446166.760077:0:18767:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794623744:12345-0@lo:400:kworker.0 Request processed in 34us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446166.760083:0:18767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789446166.760110:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1876369794624384:0@lo:400:kworker.0 00000100:00100000:3.0:1789446166.760136:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446166.760162:0:17261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794624384 00000100:00100000:3.0:1789446166.760166:0:17261:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794624384 00000100:00100000:3.0:1789446166.760190:0:17261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789446166.760196:0:17261:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876369794624384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446166.760231:0:17261:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876369794624384:12345-0@lo:400:kworker.0 Request processed in 35us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446166.760237:0:17261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1789446166.760261:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2c07a91180 x1876369794624384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789446166.760271:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1876369794624384:0@lo:400:kworker.0 00000100:00080000:3.0:1789446166.760305:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789446166.761732:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3660:1876369794623616:0@lo:400:kworker.0 00000100:00100000:0.0:1789446166.762579:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794623744:0@lo:400:kworker.0 00000100:00100000:2.0:1789446166.762666:0:17262:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1876369794623872:12345-0@lo:38:kworker.0 Request processed in 3467us (3653us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789446166.762677:0:17262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1789446166.762848:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d2f97f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789446166.762854:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789446166.762857:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1876369794623872:0@lo:38:kworker.0 00000001:00100000:0.0:1789446166.768514:0:18762:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789446166.768523:0:18762:0:(genops.c:885:class_export_put()) final put ffff9c2c05bcc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789446166.768791:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c05bcc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789446166.769158:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2c05bce800 for lustre-OST0000 00010000:00010000:0.0:1789446167.526398:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789446167.590091:0:20835:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c2d3a7f09c0 - data ffff9c2d41d40ca8/ffff9c2d41ae1400 00000020:01000000:3.0:1789446167.590224:0:20835:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c2c06bc5540 - data ffff9c2d41ca3360/ffff9c2d40d71400 00000001:00000004:3.0:1789446167.596307:0:20835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:2.0:1789446167.648106:0:20835:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789446167.648114:0:20835:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789446167.648127:0:20835:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c2d41b7f480 x1876369794621312/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789446171 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446167.648151:0:20835:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789446167.650345:0:20835:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789446167.650351:0:20835:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1789446167.650371:0:20835:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789446167.650373:0:20835:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789446167.650716:0:17285:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789446167.650721:0:17285:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1789446167.650730:0:17285:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1789446167.651295:0:20835:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789446167.651311:0:20835:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1789446167.651326:0:20835:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789446167.651328:0:20835:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789446167.651625:0:17287:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789446167.651640:0:17287:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:1.0:1789446167.651648:0:17287:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1789446167.652768:0:20835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fd7f 00000020:00000080:2.0:1789446167.652778:0:20835:0:(genops.c:885:class_export_put()) final put ffff9c2d3d062000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789446167.653025:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3d062000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789446167.654246:0:20835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fd94 00000020:00000080:2.0:1789446167.654256:0:20835:0:(genops.c:885:class_export_put()) final put ffff9c2d3d065000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789446167.654308:0:20835:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1789446167.654314:0:20835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789446167.654322:0:20835:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789446167.654327:0:20835:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9c2d3698cd40) has no exports 00000004:01000000:2.0:1789446167.654491:0:20835:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789446167.654499:0:20835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fdf6 00000020:00000080:2.0:1789446167.654504:0:20835:0:(genops.c:885:class_export_put()) final put ffff9c2d3fe3a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789446167.656484:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3d065000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789446167.658989:0:20835:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789446167.659029:0:20835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789446167.659040:0:20835:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789446167.659045:0:20835:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9c2d2a250000) has no exports 00000020:00000080:2.0:1789446167.659054:0:20835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fdef 00000020:00000080:2.0:1789446167.659062:0:20835:0:(genops.c:885:class_export_put()) final put ffff9c2d3d06b800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1789446167.659439:0:20835:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789446167.659443:0:20835:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789446167.659447:0:20835:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1789446167.659453:0:20835:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789446167.659455:0:20835:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789446167.659484:0:20835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789446167.659491:0:20835:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789446167.659497:0:20835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fde1 00000020:00000080:2.0:1789446167.659502:0:20835:0:(genops.c:885:class_export_put()) final put ffff9c2d3d06d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789446167.659506:0:20835:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789446167.659510:0:20835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789446167.659513:0:20835:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789446167.659516:0:20835:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9c2d2a254d40) has no exports 00000020:00000080:2.0:1789446167.659529:0:20835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fdda 00000020:00000080:2.0:1789446167.659532:0:20835:0:(genops.c:885:class_export_put()) final put ffff9c2d3fea3800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789446167.659969:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3fe3a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789446167.659977:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3d06b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789446167.659982:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d3d06e800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789446167.659989:0:37:0:(genops.c:885:class_export_put()) final put ffff9c2d3d069800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789446167.659992:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3d069800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789446167.659996:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789446167.660080:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3d06d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789446167.660085:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3fea3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789446167.660835:0:20835:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789446167.661263:0:20835:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789446167.661267:0:20835:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1789446167.661273:0:20835:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789446167.661275:0:20835:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789446167.661312:0:20835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789446167.661319:0:20835:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1789446167.661332:0:20835:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789446167.661338:0:20835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fdcc 00000020:00000080:2.0:1789446167.661346:0:20835:0:(genops.c:885:class_export_put()) final put ffff9c2d3d066000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789446167.661351:0:20835:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1789446167.661355:0:20835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789446167.661359:0:20835:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789446167.661362:0:20835:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff9c2c06678000) has no exports 00000020:00000080:2.0:1789446167.661367:0:20835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fdc5 00000020:00000080:2.0:1789446167.661370:0:20835:0:(genops.c:885:class_export_put()) final put ffff9c2d35d07000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789446167.662110:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2c05a58800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789446167.662121:0:37:0:(genops.c:885:class_export_put()) final put ffff9c2d3d065800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789446167.662124:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3d065800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789446167.662130:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789446167.665295:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3d066000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789446167.665309:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d35d07000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789446167.696543:0:20835:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1789446167.696553:0:20835:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789446167.696558:0:20835:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789446167.696566:0:20835:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789446167.696616:0:20835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789446167.696627:0:20835:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789446167.696671:0:20835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789446167.696674:0:20835:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789446167.696679:0:20835:0:(genops.c:885:class_export_put()) final put ffff9c2d3d062800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789446167.696683:0:20835:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3d062800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789446167.696692:0:20835:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789446167.697112:0:20835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fd9b 00000020:00000080:2.0:1789446167.697120:0:20835:0:(genops.c:885:class_export_put()) final put ffff9c2d3d061800/lustre-MDD0000_UUID 00000020:01000000:2.0:1789446167.697125:0:20835:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1789446167.697140:0:20835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789446167.697145:0:20835:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789446167.697149:0:20835:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9c2d36988000) has no exports 00000020:00000080:2.0:1789446167.697169:0:20835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789446167.697173:0:20835:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1789446167.697177:0:20835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fda2 00000020:00000080:2.0:1789446167.697181:0:20835:0:(genops.c:885:class_export_put()) final put ffff9c2d3d067000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789446167.697189:0:20835:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2c0821c800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1789446167.697192:0:20835:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c2c0821c800 3 00000020:01000004:2.0:1789446167.697195:0:20835:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c2c0821c800 from lustre-MDT0000 00000020:00000080:2.0:1789446167.698910:0:20835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789446167.698924:0:20835:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1789446167.698930:0:20835:0:(genops.c:885:class_export_put()) final put ffff9c2d3d061000/lustre-MDT0000_UUID 00000020:00000080:2.0:1789446167.698935:0:20835:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3d061000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1789446167.698948:0:20835:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1789446167.699163:0:20835:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1789446167.699169:0:20835:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1789446167.699174:0:20835:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1789446167.699178:0:20835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789446167.699183:0:20835:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789446167.699190:0:20835:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9c2c08218000 2c2066a7-cdc1-4793-80dc-4607cc2d2086 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789446167.699198:0:20835:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9c2c06b24d40) has exports, disconnecting them 00000020:00080000:2.0:1789446167.699203:0:20835:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c2c08218000), last request at 1789446075 00000020:00000080:2.0:1789446167.699481:0:20835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fd47 00000020:00010000:2.0:1789446167.699488:0:20835:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c2c08218000: total 2 00000100:00080000:2.0:1789446167.699492:0:20835:0:(import.c:65:import_set_state_nolock()) ffff9c2c0821b800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789446167.699510:0:20835:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2c08218000): rc 0 00000020:00080000:2.0:1789446167.699514:0:20835:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9c2c06b24d40) has no exports 00000100:00100000:1.0:1789446167.703184:0:17253:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c2d3a783600:17253] 0 exiting: rc = 1 00000100:00100000:2.0:1789446167.703200:0:17255:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c2d1855fe00:17255] 1 exiting: rc = 0 00000020:00000080:1.0:1789446167.703276:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d35d00000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789446167.703286:0:37:0:(genops.c:885:class_export_put()) final put ffff9c2c05a5b800/lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789446167.703298:0:17256:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c2d1855ec00:17256] 2 exiting: rc = 0 00000020:00000080:1.0:1789446167.703300:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c05a5b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1789446167.703308:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000100:00100000:2.0:1789446167.703377:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789446167.703387:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3d061800/lustre-MDD0000_UUID for lustre-MDD0000 00000100:00100000:2.0:1789446167.703388:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789446167.703393:0:37:0:(genops.c:885:class_export_put()) final put ffff9c2d3d067800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789446167.703398:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3d067800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789446167.703402:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000100:00100000:2.0:1789446167.703407:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703413:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703419:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703600:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703611:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703617:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703623:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703643:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703651:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703658:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:0.0:1789446167.703661:0:17249:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c2c08218000: total 2 00000100:00100000:2.0:1789446167.703668:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789446167.703669:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446167.703676:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703682:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703687:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703695:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703704:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703711:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703716:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703721:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703727:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703732:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703738:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703743:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703748:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703753:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703758:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703763:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703770:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703776:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703783:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703788:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703794:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703799:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703804:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703809:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789446167.703821:0:17249:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c2c08218000, canceled 0 locks, left on hash table 13. 00000100:00100000:2.0:1789446167.703827:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703833:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703838:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703845:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703851:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703860:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789446167.703860:0:17249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d42158200/0x62554ff37454ffa8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x62554ff37454ffa1 expref: 14 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446167.703871:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703881:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703892:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789446167.703892:0:17249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d2fa9ca00/0x62554ff374550042 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x62554ff37455003b expref: 13 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446167.703904:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703913:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789446167.703914:0:17249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d2fa9c600/0x62554ff37454fe66 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x62554ff37454fe5f expref: 12 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446167.703924:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.703934:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789446167.703942:0:17249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d13ba7800/0x62554ff37454ffd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x62554ff37454ffcb expref: 11 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446167.703945:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789446167.703982:0:17249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d42158a00/0x62554ff3745502fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x62554ff3745502f7 expref: 10 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446167.703994:0:17249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d2fa9c000/0x62554ff37454ff23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x62554ff37454ff1c expref: 9 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446167.704003:0:17249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d13ba7400/0x62554ff37454fe74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x62554ff37454fe6d expref: 8 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446167.704024:0:17249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d42159e00/0x62554ff37455030c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x62554ff374550305 expref: 7 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446167.704035:0:17249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d36807800/0x62554ff37454fe82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x62554ff37454fe7b expref: 6 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446167.704045:0:17249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d36807400/0x62554ff37454fd55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x62554ff37454fd4e expref: 5 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446167.704056:0:17249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d42159c00/0x62554ff37455006c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x62554ff374550065 expref: 4 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446167.704058:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.704073:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789446167.704077:0:17249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d36a50600/0x62554ff37455031a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x62554ff374550313 expref: 3 pid: 17255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446167.704086:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.704097:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789446167.704101:0:17249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d2fa9d600/0x62554ff3745500ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x62554ff3745500a4 expref: 2 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446167.704109:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.704121:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789446167.704124:0:17249:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c2c08218000, canceled 13 locks, left on hash table 0. 00000100:00100000:2.0:1789446167.704130:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.704139:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.704149:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789446167.704149:0:17249:0:(genops.c:885:class_export_put()) final put ffff9c2c08218000/2c2066a7-cdc1-4793-80dc-4607cc2d2086 00000100:00100000:2.0:1789446167.704160:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789446167.704167:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446167.704169:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789446167.704171:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446167.704175:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446167.704179:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446167.704187:0:20835:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789446167.704871:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3d067000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789446167.704878:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c08218000/2c2066a7-cdc1-4793-80dc-4607cc2d2086 for MGS 00000020:00000080:1.0:1789446167.704914:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2c0821b800 for MGS 00000020:01000000:1.0:1789446167.709214:0:20835:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c2d3d117f00 - data ffff9c2d09290438/ffff9c2d317cf000 00000020:01000000:1.0:1789446167.709408:0:20835:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c2c0697eea0 - data ffff9c2c05c12ca8/ffff9c2c07abe000 00000020:00000080:1.0:1789446167.709947:0:20835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fd2b 00000020:00000080:1.0:1789446167.710081:0:20835:0:(genops.c:885:class_export_put()) final put ffff9c2c07a68800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789446167.710143:0:20835:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2c0821c800 from MGS, refs=2 00000020:01000004:1.0:1789446167.710151:0:20835:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c2c0821c800 2 00000020:01000004:1.0:1789446167.710155:0:20835:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c2c0821c800 from MGS 00000020:00000080:0.0:1789446167.710155:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c07a68800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789446167.710174:0:20835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789446167.710181:0:20835:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789446167.710183:0:20835:0:(genops.c:885:class_export_put()) final put ffff9c2c07a6b800/MGS 00000020:00000080:1.0:1789446167.710185:0:20835:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c07a6b800/MGS for MGS 00000020:01000000:1.0:1789446167.710192:0:20835:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789446167.710254:0:20835:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789446167.710259:0:20835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789446167.710264:0:20835:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789446167.710270:0:20835:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c2d114ee000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789446167.710275:0:20835:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff9c2c06b219c0) has exports, disconnecting them 00000020:00080000:1.0:1789446167.710280:0:20835:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c2d114ee000), last request at 1789446075 00000020:00000080:1.0:1789446167.710284:0:20835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fe2e 00000020:00080000:1.0:1789446167.710292:0:20835:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2d114ee000): rc 0 00000020:00000080:1.0:1789446167.710308:0:20835:0:(genops.c:885:class_export_put()) final put ffff9c2d114ee000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789446167.710759:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d114ee000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789446167.712016:0:20835:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789446167.712022:0:20835:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789446167.712026:0:20835:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789446167.712032:0:20835:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789446167.712175:0:20835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789446167.712189:0:20835:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789446167.712196:0:20835:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c2c0821c800 1 00000020:00000080:0.0:1789446167.712201:0:20835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fd1d 00000020:00000080:0.0:1789446167.712208:0:20835:0:(genops.c:885:class_export_put()) final put ffff9c2c07a68000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789446167.712213:0:20835:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789446167.712217:0:20835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789446167.712221:0:20835:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789446167.712225:0:20835:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9c2d3698b380) has no exports 00000020:00000080:2.0:1789446167.712645:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d102a5000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789446167.712654:0:8:0:(genops.c:885:class_export_put()) final put ffff9c2d3ede2000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789446167.712657:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3ede2000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789446167.712662:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789446167.712734:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c07a68000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789446167.737607:0:20835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789446167.737635:0:20835:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789446167.737649:0:20835:0:(genops.c:885:class_export_put()) final put ffff9c2c0821a800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789446167.737653:0:20835:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c0821a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789446167.737663:0:20835:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789446167.737809:0:20835:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c2c0821a000 00000020:02000400:2.0:1789446167.737901:0:20835:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789446168.550256:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446169.574103:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446170.599038:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789446170.854534:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1876369794624512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789446170.854605:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446170.854752:0:18769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794624512 00000100:00100000:0.0:1789446170.854761:0:18769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794624512 00000100:00100000:0.0:1789446170.854834:0:18769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789446170.854844:0:18769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876369794624512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789446170.854881:0:18769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789446170.854935:0:18769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876369794624512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446170.854942:0:18769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789446170.855049:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1876369794624512:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789446170.855363:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:1.0:1789446171.294262:0:21036:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000040:00080000:1.0:1789446171.303558:0:18013:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1789446171.316528:0:21036:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1789446171.316587:0:21036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d42158600/0x62554ff37454ff1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff37454ff23 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446171.316602:0:21036:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d42158600/0x62554ff37454ff1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff37454ff23 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446171.316620:0:21036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d42158600/0x62554ff37454ff1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff37454ff23 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446171.316627:0:21036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9c2d42158600/0x62554ff37454ff1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff37454ff23 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446171.316650:0:21036:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789446171.316655:0:21036:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789446171.316679:0:21036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789446171.316684:0:21036:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789446171.316689:0:21036:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789446171.316695:0:21036:0:(import.c:65:import_set_state_nolock()) ffff9c2d2f97f000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789446171.316700:0:21036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789446171.316702:0:21036:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789446171.316705:0:21036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789446171.322270:0:19710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789446171.322285:0:19710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d42158600/0x62554ff37454ff1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff37454ff23 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446171.322296:0:19710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d42158600 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:3.0:1789446171.322300:0:19710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d42158600/0x62554ff37454ff1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff37454ff23 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446171.322311:0:19710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d42158600/0x62554ff37454ff1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x62554ff37454ff23 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789446171.322319:0:19710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d42158600/0x62554ff37454ff1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x62554ff37454ff23 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789446171.322325:0:19710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789446171.322328:0:19710:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789446171.322331:0:19710:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789446171.322374:0:19710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9c2d42158600/0x62554ff37454ff1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff37454ff23 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446171.322381:0:19710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789446171.322410:0:19710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d42158600/0x62554ff37454ff1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff37454ff23 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446171.322418:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d42158600/0x62554ff37454ff1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff37454ff23 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446171.322432:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446171.322433:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446171.322435:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446171.322527:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789446171.322547:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3658:1876369794624640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789446171.322607:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789446171.323536:0:21036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c400/0x62554ff37454fe7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff37454fe82 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446171.323561:0:21036:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c400/0x62554ff37454fe7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff37454fe82 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446171.323568:0:21036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c400/0x62554ff37454fe7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff37454fe82 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446171.323575:0:21036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c400/0x62554ff37454fe7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff37454fe82 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446171.323589:0:21036:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789446171.323594:0:21036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36807000/0x62554ff3745500a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745500ab expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446171.323600:0:21036:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36807000/0x62554ff3745500a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff3745500ab expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446171.323606:0:21036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36807000/0x62554ff3745500a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff3745500ab expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446171.323621:0:21036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9c2d36807000/0x62554ff3745500a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff3745500ab expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446171.323632:0:21036:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789446171.323637:0:21036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7a00/0x62554ff374550313 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff37455031a expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446171.323644:0:21036:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7a00/0x62554ff374550313 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff37455031a expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446171.323661:0:21036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7a00/0x62554ff374550313 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff37455031a expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446171.323667:0:21036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7a00/0x62554ff374550313 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff37455031a expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446171.323678:0:21036:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789446171.323683:0:21036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37454fe6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff37454fe74 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446171.323690:0:21036:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37454fe6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff37454fe74 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446171.323696:0:21036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37454fe6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff37454fe74 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446171.323702:0:21036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37454fe6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff37454fe74 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446171.323710:0:21036:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1789446171.323713:0:21036:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1789446171.323738:0:21036:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1789446171.323742:0:21036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1789446171.323746:0:21036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789446171.323751:0:21036:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1789446171.323756:0:21036:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9c2d35c54000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789446171.323761:0:21036:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9c2d2f97d800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789446171.323766:0:21036:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff9c2c0667b380) has exports, disconnecting them 00000020:00080000:2.0:1789446171.323776:0:21036:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9c2d35c54000), last request at 1789446166 00000020:00000080:2.0:1789446171.323783:0:21036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff374550096 00000100:00080000:2.0:1789446171.323799:0:21036:0:(import.c:65:import_set_state_nolock()) ffff9c2d35c50800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789446171.323838:0:21036:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2d35c54000): rc 0 00000020:00000080:2.0:1789446171.323841:0:21036:0:(genops.c:885:class_export_put()) final put ffff9c2d35c54000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1789446171.323849:0:21036:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9c2d2f97d800), last request at 1789446166 00000020:00000080:2.0:1789446171.323852:0:21036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fffc 00000100:00080000:2.0:1789446171.323857:0:21036:0:(import.c:65:import_set_state_nolock()) ffff9c2d2f97d000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789446171.323864:0:21036:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2d2f97d800): rc 0 00000020:00000080:2.0:1789446171.323866:0:21036:0:(genops.c:885:class_export_put()) final put ffff9c2d2f97d800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1789446171.323872:0:21036:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffae1081ccbae0 00000100:00080000:2.0:1789446171.323887:0:21036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789446171.323896:0:21036:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9c2d3edcc000 x1876369794623232/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789446182 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446171.323906:0:21036:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1789446171.325308:0:20289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794624640 00000100:00100000:3.0:1789446171.325331:0:20289:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794624640 00000100:00100000:3.0:1789446171.325375:0:20289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789446171.325382:0:20289:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a234380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3658:x1876369794624640:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789446171.325389:0:20289:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789446171 with bad export cookie 7085657495784717639 00000100:00100000:1.0:1789446171.326651:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794623232:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789446171.326806:0:17250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789446171.326815:0:17250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c400/0x62554ff37454fe7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff37454fe82 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446171.326826:0:17250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9c400 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:0.0:1789446171.326830:0:17250:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c400/0x62554ff37454fe7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff37454fe82 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446171.326840:0:17250:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c400/0x62554ff37454fe7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x62554ff37454fe82 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789446171.326859:0:17250:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c400/0x62554ff37454fe7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x62554ff37454fe82 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446171.326865:0:17250:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789446171.326868:0:17250:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1789446171.326871:0:17250:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1789446171.326906:0:17250:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c400/0x62554ff37454fe7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff37454fe82 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446171.326913:0:17250:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789446171.326945:0:17250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c400/0x62554ff37454fe7b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff37454fe82 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446171.326953:0:17250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c400/0x62554ff37454fe7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff37454fe82 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446171.326987:0:17250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789446171.326990:0:17250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d36807000/0x62554ff3745500a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff3745500ab expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446171.326995:0:17250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36807000 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:0.0:1789446171.326998:0:17250:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d36807000/0x62554ff3745500a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff3745500ab expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446171.327005:0:17250:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d36807000/0x62554ff3745500a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x62554ff3745500ab expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789446171.327011:0:17250:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d36807000/0x62554ff3745500a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x62554ff3745500ab expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446171.327027:0:17250:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789446171.327029:0:17250:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789446171.327031:0:17250:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789446171.327045:0:17250:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9c2d36807000/0x62554ff3745500a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff3745500ab expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446171.327052:0:17250:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789446171.327068:0:17250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d36807000/0x62554ff3745500a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff3745500ab expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446171.327074:0:17250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d36807000/0x62554ff3745500a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff3745500ab expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446171.327087:0:17250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789446171.327090:0:17250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7a00/0x62554ff374550313 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff37455031a expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446171.327095:0:17250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d35ea7a00 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:0.0:1789446171.327097:0:17250:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7a00/0x62554ff374550313 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff37455031a expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446171.327104:0:17250:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7a00/0x62554ff374550313 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x62554ff37455031a expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789446171.327109:0:17250:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7a00/0x62554ff374550313 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x62554ff37455031a expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446171.327115:0:17250:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789446171.327117:0:17250:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789446171.327125:0:17250:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789446171.327142:0:17250:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7a00/0x62554ff374550313 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff37455031a expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446171.327148:0:17250:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789446171.327165:0:17250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7a00/0x62554ff374550313 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff37455031a expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446171.327172:0:17250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7a00/0x62554ff374550313 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff37455031a expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446171.327181:0:17250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446171.327184:0:17250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37454fe6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff37454fe74 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446171.327190:0:17250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36806400 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:0.0:1789446171.327193:0:17250:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37454fe6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff37454fe74 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446171.327199:0:17250:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37454fe6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x62554ff37454fe74 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789446171.327206:0:17250:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37454fe6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x62554ff37454fe74 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446171.327210:0:17250:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789446171.327213:0:17250:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789446171.327214:0:17250:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789446171.327227:0:17250:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37454fe6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff37454fe74 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446171.327233:0:17250:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789446171.327245:0:17250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37454fe6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff37454fe74 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446171.327251:0:17250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37454fe6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x62554ff37454fe74 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446171.327262:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446171.327264:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446171.327265:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446171.327273:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789446171.327283:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d35c54000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1789446171.327326:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d2f97d800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1789446171.327346:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d35c50800 for lustre-MDT0001 00000020:00000080:0.0:1789446171.327350:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d2f97d000 for lustre-MDT0001 00000100:00100000:0.0:1789446171.327367:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3fe34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3659:1876369794624896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789446171.327427:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446171.327468:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789446171.327475:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3fe34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3659:1876369794625024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789446171.327497:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446171.327526:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794624896 00000100:00100000:0.0:1789446171.327532:0:17247:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794624896 00000100:00100000:0.0:1789446171.327557:0:17247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794625024 00000100:00100000:0.0:1789446171.327560:0:17247:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794625024 00000100:00100000:0.0:1789446171.327572:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789446171.327580:0:17247:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ff47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3659:x1876369794624896:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789446171.327586:0:17247:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789446171 with bad export cookie 7085657495784717639 00000100:00100000:0.0:1789446171.327639:0:17247:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ff47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3659:x1876369794624896:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (211us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789446171.327647:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789446171.327672:0:17247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789446171.327676:0:17247:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2fa3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3659:x1876369794625024:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789446171.327681:0:17247:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789446171 with bad export cookie 7085657495784717639 00000100:00100000:0.0:1789446171.327709:0:17247:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2fa3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3659:x1876369794625024:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (212us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789446171.327714:0:17247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1789446171.327744:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.148@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789446171.327749:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9c2d3ebf6000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789446171.327752:0:3659:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1789446171.328999:0:21036:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789446171.329007:0:21036:0:(import.c:65:import_set_state_nolock()) ffff9c2d205f9800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1789446171.332061:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789446171.335446:0:21036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789446171.335454:0:21036:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1789446171.335468:0:21036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789446171.335540:0:21036:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789446171.335568:0:21036:0:(import.c:65:import_set_state_nolock()) ffff9c2d205fa000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789446171.335590:0:21036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789446171.335592:0:21036:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1789446171.335599:0:21036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789446171.335676:0:21036:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789446171.335685:0:21036:0:(import.c:65:import_set_state_nolock()) ffff9c2d31d3a800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789446171.335737:0:21036:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9c2c0667b380) has no exports 00000100:00100000:2.0:1789446171.337403:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794625280:0@lo:9:umount.0 00000100:00100000:2.0:1789446171.337478:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446171.337519:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794625408:0@lo:9:umount.0 00000100:00100000:2.0:1789446171.337543:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446171.337587:0:19708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794625280 00000100:00100000:2.0:1789446171.337594:0:19708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794625280 00000100:00100000:2.0:1789446171.337645:0:19708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794625408 00000100:00100000:2.0:1789446171.337649:0:19708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794625408 00000100:00100000:2.0:1789446171.337679:0:19708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789446171.337688:0:19708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1876369794625280:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789446171.337715:0:19708:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff374550026 00000100:00080000:2.0:1789446171.337725:0:19708:0:(import.c:65:import_set_state_nolock()) ffff9c2d3df28800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789446171.337769:0:19708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1789446171.337901:0:19708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3656:x1876369794625280:12345-0@lo:9:umount.0 Request processed in 213us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446171.337908:0:19708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789446171.337933:0:19708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789446171.337939:0:19708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1876369794625408:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789446171.337952:0:19708:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff3745500ce 00000100:00080000:2.0:1789446171.337978:0:19708:0:(import.c:65:import_set_state_nolock()) ffff9c2c05bcb000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789446171.338001:0:19708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1789446171.338080:0:19708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3656:x1876369794625408:12345-0@lo:9:umount.0 Request processed in 140us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446171.338086:0:19708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1789446171.338126:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d205fa000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789446171.338138:0:3656:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789446171.338244:0:3656:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789446171.338249:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794625280:0@lo:9:umount.0 00000100:00080000:2.0:1789446171.338266:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d31d3a800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789446171.338275:0:3656:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789446171.338277:0:3656:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789446171.338280:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794625408:0@lo:9:umount.0 00000100:00080000:2.0:1789446171.340190:0:17257:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789446171.342698:0:20289:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a234380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3658:x1876369794624640:12345-0@lo:103:ldlm_bl.0 Request processed in 17311us (20086us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789446171.342714:0:20289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1789446171.352717:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446171.352728:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789446171.366067:0:3659:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.148@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789446171.366073:0:3659:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789446171.366084:0:3659:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2c07a91f80 x1876369794624640/t0(0) o103->MGC192.168.206.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789446187 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446171.366098:0:3659:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2d3fe34a80 x1876369794624896/t0(0) o103->MGC192.168.206.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789446187 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446171.366106:0:3659:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2d3fe34000 x1876369794625024/t0(0) o103->MGC192.168.206.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789446187 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789446171.366994:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3ff45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c2066a7-cdc1-4793-80dc-4607cc2d2086:0:1876369794625152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789446171.367027:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 10000000:01000000:0.0:1789446171.367064:0:3659:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789446171.367073:0:3659:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789446171.367074:0:3659:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789446171.367201:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9c2d3ebf6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789446171.367206:0:3659:0:(import.c:545:import_select_connection()) MGC192.168.206.148@tcp: connect to NID 0@lo last attempt 457 00000100:00080000:0.0:1789446171.367220:0:3659:0:(import.c:666:import_select_connection()) MGC192.168.206.148@tcp: import ffff9c2d3ebf6000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789446171.367270:0:3659:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2d2fa3f480 x1876369794625536/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789446171.367309:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3fe34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3659:1876369794624896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789446171.367343:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3656:1876369794625536:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1789446171.367386:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876369794625536 offset 0 length 520: 4 00000100:00100000:0.0:1789446171.367462:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3fe34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3659:1876369794625024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789446171.367522:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3658:1876369794624640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789446171.367556:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d37c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c2066a7-cdc1-4793-80dc-4607cc2d2086:0:1876369794624768:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1789446171.373830:0:21036:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9c2c0667b380) has no exports 00000020:01000000:2.0:1789446171.420655:0:21036:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c2c08906480 - data ffff9c2c05c19510/ffff9c2d41b00800 00000020:01000000:2.0:1789446171.420832:0:21036:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c2c064350c0 - data ffff9c2d20310438/ffff9c2d3156d800 00000001:00000004:2.0:1789446171.433054:0:21036:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:0.0:1789446171.496933:0:21036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789446171.496942:0:21036:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789446171.496949:0:21036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789446171.500364:0:21036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789446171.500377:0:21036:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1789446171.503222:0:21036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789446171.503230:0:21036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789446171.511473:0:18000:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789446171.511481:0:18000:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:3.0:1789446171.511518:0:18000:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1789446171.515567:0:21036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789446171.515574:0:21036:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:0.0:1789446171.515602:0:21036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789446171.515604:0:21036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789446171.517913:0:18003:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789446171.517921:0:18003:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1789446171.517935:0:18003:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1789446171.521258:0:21036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fe90 00000020:00000080:1.0:1789446171.521282:0:21036:0:(genops.c:885:class_export_put()) final put ffff9c2d39f48000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789446171.521918:0:21036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fea5 00000020:00000080:1.0:1789446171.521924:0:21036:0:(genops.c:885:class_export_put()) final put ffff9c2d205f9000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789446171.521929:0:21036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1789446171.521934:0:21036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789446171.521942:0:21036:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789446171.521946:0:21036:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9c2d2fb499c0) has no exports 00000020:00000080:3.0:1789446171.522172:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d39f48000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789446171.522180:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d205f9000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:1.0:1789446171.522485:0:21036:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789446171.522494:0:21036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fef9 00000020:00000080:1.0:1789446171.522500:0:21036:0:(genops.c:885:class_export_put()) final put ffff9c2d3fe90800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789446171.522576:0:21036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1789446171.522581:0:21036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789446171.522586:0:21036:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789446171.522590:0:21036:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9c2d2fb48000) has no exports 00000020:00000080:1.0:1789446171.522595:0:21036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fef2 00000020:00000080:1.0:1789446171.522600:0:21036:0:(genops.c:885:class_export_put()) final put ffff9c2d205fc800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789446171.523168:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3fe90800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1789446171.524110:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d205fc800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1789446171.524577:0:21036:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1789446171.524582:0:21036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789446171.524586:0:21036:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1789446171.524592:0:21036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789446171.524600:0:21036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789446171.524684:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d31d3a800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789446171.526573:0:21036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789446171.526599:0:21036:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789446171.526605:0:21036:0:(genops.c:885:class_export_put()) final put ffff9c2c06785000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789446171.526620:0:21036:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c06785000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1789446171.526629:0:21036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789446171.526722:0:21036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fee4 00000020:00000080:1.0:1789446171.526729:0:21036:0:(genops.c:885:class_export_put()) final put ffff9c2c06787000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789446171.526791:0:21036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1789446171.526796:0:21036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789446171.526801:0:21036:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789446171.526805:0:21036:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9c2d2fb4cd40) has no exports 00000020:00000080:1.0:1789446171.526811:0:21036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fedd 00000020:00000080:1.0:1789446171.526814:0:21036:0:(genops.c:885:class_export_put()) final put ffff9c2d205fe800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789446171.527589:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c06787000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:1.0:1789446171.528825:0:21036:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1789446171.528832:0:21036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789446171.528836:0:21036:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1789446171.528852:0:21036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789446171.528855:0:21036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789446171.532351:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d205fe800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789446171.532865:0:21036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789446171.532877:0:21036:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1789446171.533020:0:21036:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789446171.533029:0:21036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fec8 00000020:00000080:1.0:1789446171.533038:0:21036:0:(genops.c:885:class_export_put()) final put ffff9c2d205fb800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789446171.533044:0:21036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1789446171.533053:0:21036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789446171.533058:0:21036:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789446171.533073:0:21036:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9c2d35f499c0) has no exports 00000020:00000080:1.0:1789446171.533080:0:21036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fec1 00000020:00000080:1.0:1789446171.533083:0:21036:0:(genops.c:885:class_export_put()) final put ffff9c2d205fa800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789446171.533234:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d205fa000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789446171.533243:0:8:0:(genops.c:885:class_export_put()) final put ffff9c2d31d39800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789446171.533245:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d31d39800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1789446171.533262:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789446171.533358:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d205fb800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789446171.533366:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d205fa800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789446171.534646:0:21036:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789446171.534653:0:21036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789446171.534661:0:21036:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789446171.534668:0:21036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789446171.534732:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d205f9800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789446171.534737:0:21036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789446171.534757:0:21036:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789446171.534761:0:21036:0:(genops.c:885:class_export_put()) final put ffff9c2d205fe000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789446171.534765:0:21036:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d205fe000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1789446171.534787:0:21036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789446171.535407:0:21036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789446171.535414:0:21036:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789446171.535417:0:21036:0:(genops.c:885:class_export_put()) final put ffff9c2c079a6800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789446171.535420:0:21036:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c079a6800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789446171.535424:0:21036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789446171.535579:0:21036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454feac 00000020:00000080:0.0:1789446171.535587:0:21036:0:(genops.c:885:class_export_put()) final put ffff9c2d205f8000/lustre-MDD0001_UUID 00000020:01000000:0.0:1789446171.535604:0:21036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789446171.535608:0:21036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789446171.535622:0:21036:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789446171.535626:0:21036:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9c2d35f4cd40) has no exports 00000020:00000080:0.0:1789446171.535658:0:21036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789446171.535662:0:21036:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789446171.535665:0:21036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454feb3 00000020:00000080:0.0:1789446171.535670:0:21036:0:(genops.c:885:class_export_put()) final put ffff9c2d205f8800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789446171.535677:0:21036:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2c079da000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789446171.535680:0:21036:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c2c079da000 2 00000020:01000004:0.0:1789446171.535683:0:21036:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c2c079da000 from lustre-MDT0001 00000020:00000080:0.0:1789446171.535697:0:21036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789446171.535700:0:21036:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789446171.535702:0:21036:0:(genops.c:885:class_export_put()) final put ffff9c2d35d03800/lustre-MDT0001_UUID 00000020:00000080:0.0:1789446171.535704:0:21036:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d35d03800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789446171.535710:0:21036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789446171.535737:0:21036:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789446171.535740:0:21036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789446171.535743:0:21036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789446171.536143:0:21036:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789446171.536152:0:21036:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9c2d3fe97800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789446171.536158:0:21036:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff9c2c069e0000) has exports, disconnecting them 00000020:00080000:0.0:1789446171.536163:0:21036:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9c2d3fe97800), last request at 1789446089 00000020:00000080:0.0:1789446171.536178:0:21036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454ff31 00000020:00080000:0.0:1789446171.536192:0:21036:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2d3fe97800): rc 0 00000020:00000080:0.0:1789446171.536195:0:21036:0:(genops.c:885:class_export_put()) final put ffff9c2d3fe97800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1789446171.536401:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d205f8000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1789446171.536408:0:8:0:(genops.c:885:class_export_put()) final put ffff9c2d205ff000/lustre-MDD0001_UUID 00000020:00000080:3.0:1789446171.536411:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d205ff000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1789446171.536424:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1789446171.536564:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d205f8800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789446171.536568:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3fe97800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1789446171.616173:0:21036:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1789446171.616181:0:21036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789446171.616186:0:21036:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789446171.616523:0:21036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789446171.616643:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d2f97f000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789446171.616738:0:21036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789446171.616747:0:21036:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1789446171.616753:0:21036:0:(genops.c:885:class_export_put()) final put ffff9c2d2f97a000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1789446171.616757:0:21036:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d2f97a000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1789446171.616765:0:21036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1789446171.616833:0:21036:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c2c079da000 1 00000020:00000080:1.0:1789446171.616839:0:21036:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fe58 00000020:00000080:1.0:1789446171.616865:0:21036:0:(genops.c:885:class_export_put()) final put ffff9c2c079a4000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1789446171.616878:0:21036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1789446171.616883:0:21036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789446171.616911:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c079a4000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789446171.617454:0:21036:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789446171.617461:0:21036:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff9c2c06b20000) has no exports 00000020:00000080:0.0:1789446171.645522:0:21036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789446171.645535:0:21036:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1789446171.645540:0:21036:0:(genops.c:885:class_export_put()) final put ffff9c2c079db000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789446171.645545:0:21036:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c079db000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1789446171.645557:0:21036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1789446171.645701:0:21036:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c2c079d9800 00000020:01000000:0.0:1789446171.645733:0:21036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789446171.645737:0:21036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789446171.645742:0:21036:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789446171.645746:0:21036:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9c2c066799c0) has no exports 00000100:00100000:1.0:1789446171.645887:0:17263:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9c2d112f1400:17263] 2 exiting: rc = 0 00000100:00100000:3.0:1789446171.646174:0:17261:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9c2d2f83e600:17261] 0 exiting: rc = 1 00000100:00100000:3.0:1789446171.646290:0:20169:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9c2c0751ec00:20169] 3 exiting: rc = 0 00000100:00100000:2.0:1789446171.646834:0:17262:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9c2d3a783a00:17262] 1 exiting: rc = 0 00000100:00100000:0.0:1789446171.647535:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647543:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647548:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647554:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647560:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647566:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647572:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647577:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647582:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647587:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647591:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647596:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647601:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647606:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647621:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647627:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647632:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647637:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647642:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647647:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647666:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647672:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647676:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647681:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647686:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647692:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647698:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647703:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647708:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647714:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647788:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647796:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647802:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647807:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647813:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647818:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647823:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647829:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647834:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647839:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647844:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647850:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647855:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647941:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.647949:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.648428:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.648440:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.648446:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.648451:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.648455:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.648460:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.648465:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.648471:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.648477:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.648482:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.648499:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.648504:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.648510:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.648516:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.648521:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.648527:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.648533:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.648539:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.648543:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.653767:0:17265:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9c2d2f83ea00:17265] 1 exiting: rc = 0 00000100:00100000:2.0:1789446171.654237:0:17264:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9c2d112f0400:17264] 0 exiting: rc = 1 00000100:00100000:1.0:1789446171.654475:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654483:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654490:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654495:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654500:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654506:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654511:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654516:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654520:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654525:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654529:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654534:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654539:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654543:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654548:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654553:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654558:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654563:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654567:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654572:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654577:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654593:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654599:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654604:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654619:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654625:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654630:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654635:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654641:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654646:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654651:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654655:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654661:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654666:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654671:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654676:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654681:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654685:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654690:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654694:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654699:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654703:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654708:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654712:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654716:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654730:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654735:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654740:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654744:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654749:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654754:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654759:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654763:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654768:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654773:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654777:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654787:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654792:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654797:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654802:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654808:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654813:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654817:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.654822:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.655499:0:17266:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9c2d112f0a00:17266] 0 exiting: rc = 1 00000100:00100000:1.0:1789446171.655567:0:17267:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9c2d35d9b000:17267] 1 exiting: rc = 0 00000100:00100000:0.0:1789446171.655691:0:18001:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff9c2d29bb9000:18001] 2 exiting: rc = 0 00000100:00100000:1.0:1789446171.655898:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.655905:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.655910:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.655916:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.655921:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.655927:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.655932:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.655937:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.655942:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.655947:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.655953:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.655996:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656002:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656010:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656025:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656047:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656054:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656060:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656066:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656071:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656077:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656082:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656088:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656093:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656101:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656121:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656126:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656148:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656154:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656160:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656166:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656172:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656177:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656182:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656187:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656192:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656197:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656203:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656209:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656229:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656237:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656241:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656247:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656252:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656257:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656262:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656268:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656274:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656279:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656284:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656290:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656309:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656319:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656324:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656329:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656335:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656350:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656361:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656377:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656383:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656396:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656401:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656408:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446171.656415:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789446171.671261:0:17269:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9c2d35d9ba00:17269] 1 exiting: rc = 0 00000100:00100000:1.0:1789446171.671552:0:17268:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9c2d35d9a600:17268] 0 exiting: rc = 1 00000100:00100000:0.0:1789446171.671746:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671756:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671764:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671771:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671779:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671786:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671790:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671795:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671802:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671808:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671815:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671822:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671829:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671835:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671841:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671847:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671852:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671872:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671880:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671886:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671891:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671900:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671909:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671919:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671938:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671944:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.671950:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672165:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672173:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672179:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672184:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672189:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672194:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672199:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672204:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672209:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672215:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672219:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672224:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672230:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672235:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672240:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672245:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672251:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672255:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672259:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672264:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672268:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672273:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672277:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672282:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672287:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672292:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672297:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672302:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672307:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672312:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672490:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672499:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672512:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672517:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672521:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672525:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.672529:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789446171.673051:0:17270:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9c2c077d8000:17270] 0 exiting: rc = 1 00000100:00100000:0.0:1789446171.673280:0:17271:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9c2d0a43be00:17271] 1 exiting: rc = 0 00000100:00100000:0.0:1789446171.673335:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673340:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673345:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673350:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673355:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673360:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673365:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673371:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673375:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673381:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673387:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673393:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673398:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673403:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673408:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673412:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673417:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673422:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673428:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673433:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673438:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673443:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673448:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673454:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673459:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673464:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673470:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673475:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673480:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673495:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673499:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673504:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673509:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673514:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673519:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673525:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673530:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673536:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673541:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673547:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673552:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673556:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673561:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673566:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673571:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673576:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673580:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673584:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673590:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673595:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673599:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673604:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673714:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673724:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673729:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673734:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673739:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673744:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673749:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673753:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673757:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673762:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673766:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.673771:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789446171.675343:0:17272:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9c2d0a43ae00:17272] 0 exiting: rc = 1 00000100:00100000:3.0:1789446171.675445:0:17273:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9c2d0a43bc00:17273] 1 exiting: rc = 0 00000100:00100000:0.0:1789446171.675553:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675560:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675565:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675571:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675575:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675581:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675587:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675595:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675603:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675620:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675631:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675637:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675643:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675648:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675654:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675659:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675664:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675668:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675674:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675679:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675684:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675689:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675694:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675698:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675702:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675707:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675711:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675716:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675790:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675795:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675800:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675805:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675810:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675817:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675822:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675841:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675846:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675851:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.675855:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678124:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678144:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678150:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678155:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678160:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678165:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678170:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678174:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678179:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678184:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678188:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678193:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678198:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678203:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678208:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678213:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678218:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678223:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678229:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678234:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678238:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678243:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678248:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678253:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.678258:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446171.686737:0:17274:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9c2c06b01000:17274] 0 exiting: rc = 1 00000100:00100000:2.0:1789446171.686993:0:17275:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9c2d0a43a600:17275] 1 exiting: rc = 0 00000100:00100000:2.0:1789446171.687149:0:17276:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9c2d0a43a200:17276] 2 exiting: rc = 0 00000100:00100000:0.0:1789446171.691376:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691398:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691422:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691429:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691434:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691439:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691459:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691464:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691469:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691476:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691481:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691487:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691493:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691499:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691505:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691510:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691517:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691524:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691530:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691536:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691541:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691547:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691552:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691557:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691561:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691567:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691586:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691593:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691598:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691604:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691618:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691625:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691631:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691636:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691642:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691648:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691653:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691658:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691664:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691669:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691674:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691688:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691693:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691698:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691704:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691709:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691714:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691720:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691726:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691732:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691753:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691760:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691766:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691772:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691779:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691785:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691791:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691796:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691809:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691815:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691821:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691827:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691832:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446171.691846:0:21036:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789446171.704486:0:21036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789446171.704500:0:21036:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789446171.704505:0:21036:0:(genops.c:885:class_export_put()) final put ffff9c2d3ebf1000/MDS_uuid 00000020:00000080:0.0:1789446171.704515:0:21036:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3ebf1000/MDS_uuid for MDS 00000020:01000000:0.0:1789446171.704524:0:21036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789446171.704676:0:21036:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1789446171.869568:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789446171.880008:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789446171.880018:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789446171.880022:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c2d31d3c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789446171.880029:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 548 00000100:00080000:3.0:1789446171.880035:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789446171.880048:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2d31d3c000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789446171.880097:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2c07a93b80 x1876369794625664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789446171.880139:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789446171.880143:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789446171.880145:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c2c079a1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789446171.880149:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 548 00000100:00080000:3.0:1789446171.880152:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789446171.880157:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2c079a1800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789446171.880168:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2c07a90380 x1876369794625920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789446171.880234:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1876369794625664:0@lo:38:kworker.0 00000400:00000100:3.0:1789446171.880282:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876369794625664 offset 0 length 520: 4 00000100:00100000:3.0:1789446171.880311:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1876369794625920:0@lo:38:kworker.0 00000400:00000100:3.0:1789446171.880325:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876369794625920 offset 0 length 520: 4 00000100:00100000:0.0:1789446171.880477:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1876369794625792:0@lo:400:kworker.0 00000400:00000100:0.0:1789446171.880505:0:3658:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876369794625792 offset 0 length 224: 4 00000100:00100000:0.0:1789446171.880541:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1876369794626048:0@lo:400:kworker.0 00000400:00000100:0.0:1789446171.880561:0:3659:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876369794626048 offset 0 length 224: 4 00010000:00010000:2.0:1789446172.903639:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446173.926097:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446174.954298:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789446175.509304:0:21238:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789446175.530874:0:21238:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789446175.530927:0:21238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d42158c00/0x62554ff37454ffcb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff37454ffd2 expref: -99 pid: 18761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446175.530944:0:21238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d42158c00/0x62554ff37454ffcb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff37454ffd2 expref: -99 pid: 18761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446175.530994:0:21238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d42158c00/0x62554ff37454ffcb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff37454ffd2 expref: -99 pid: 18761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446175.531001:0:21238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9c2d42158c00/0x62554ff37454ffcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff37454ffd2 expref: -99 pid: 18761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446175.531070:0:21238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789446175.531076:0:21238:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789446175.531101:0:21238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789446175.531112:0:21238:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2c07a93b80 x1876369794625664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789446191 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446175.531133:0:21238:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789446175.531139:0:21238:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789446175.531145:0:21238:0:(import.c:65:import_set_state_nolock()) ffff9c2d31d3c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789446175.531150:0:21238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789446175.531154:0:21238:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2c07a93b80 x1876369794625664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789446191 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446175.531161:0:21238:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789446175.531164:0:21238:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:3.0:1789446175.531278:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1876369794625664:0@lo:38:kworker.0 00000100:00080000:2.0:1789446175.532443:0:21238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789446175.532456:0:21238:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2c07a93480 x1876369794625792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446187 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446175.532527:0:21238:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789446175.532532:0:21238:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789446175.532686:0:21238:0:(import.c:65:import_set_state_nolock()) ffff9c2d3df28000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789446175.532844:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3656:1876369794626176:0@lo:39:umount.0 00000400:00000100:3.0:1789446175.532893:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876369794626176 offset 0 length 224: 4 00010000:00010000:0.0:1789446175.533897:0:17249:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446175.533909:0:17249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d42158c00/0x62554ff37454ffcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff37454ffd2 expref: -99 pid: 18761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446175.533920:0:17249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d42158c00 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:0.0:1789446175.533924:0:17249:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d42158c00/0x62554ff37454ffcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff37454ffd2 expref: -99 pid: 18761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446175.533935:0:17249:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d42158c00/0x62554ff37454ffcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x62554ff37454ffd2 expref: -99 pid: 18761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789446175.533942:0:17249:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d42158c00/0x62554ff37454ffcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x62554ff37454ffd2 expref: -99 pid: 18761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446175.533948:0:17249:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789446175.533951:0:17249:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789446175.533976:0:17249:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789446175.533993:0:17249:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c2d3ebf6000 00010000:00010000:0.0:1789446175.533998:0:17249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d42158c00/0x62554ff37454ffcb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x62554ff37454ffd2 expref: -99 pid: 18761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446175.534004:0:17249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d42158c00/0x62554ff37454ffcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x62554ff37454ffd2 expref: -99 pid: 18761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446175.534123:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1876369794625792:0@lo:400:kworker.0 00010000:00010000:1.0:1789446175.534147:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446175.534149:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446175.534150:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446175.974936:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446176.998304:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789446176.998323:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2c2066a7-cdc1-4793-80dc-4607cc2d2086->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789446176.998328:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2c2066a7-cdc1-4793-80dc-4607cc2d2086->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789446176.998331:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789446176.998334:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789446176.998414:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1876369794626304:0@lo:400:kworker.0 00000400:00000100:3.0:1789446176.998467:0:3660:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876369794626304 offset 0 length 224: 4 00000001:00100000:0.0:1789446176.999446:0:18762:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789446176.999452:0:18762:0:(genops.c:885:class_export_put()) final put ffff9c2d3df2b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789446176.999840:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3df2b800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789446176.999887:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d3df28800 for lustre-OST0000 00000001:00100000:0.0:1789446177.000210:0:19580:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789446177.000214:0:19580:0:(genops.c:885:class_export_put()) final put ffff9c2c05bc8000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789446177.000260:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c05bc8000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789446177.000295:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2c05bcb000 for lustre-OST0001 00010000:00010000:1.0:1789446178.022729:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446179.046090:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446180.070468:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446181.094487:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789446181.670100:0:3656:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789446171/real 1789446171] req@ffff9c2d2fa3f480 x1876369794625536/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789446181 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789446181.670134:0:3656:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c2d2fa3f480 x1876369794625536/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789446181 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789446181.670154:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d3ebf6000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789446181.670183:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1789446181.670187:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3656:1876369794625536:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1789446181.670287:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2c2066a7-cdc1-4793-80dc-4607cc2d2086->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789446181.670292:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1789446181.670295:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c2d3ebf6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789446181.670299:0:37:0:(import.c:545:import_select_connection()) MGC192.168.206.148@tcp: connect to NID 0@lo last attempt 553 00000100:00080000:2.0:1789446181.670304:0:37:0:(import.c:630:import_select_connection()) MGC192.168.206.148@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789446181.670314:0:37:0:(import.c:666:import_select_connection()) MGC192.168.206.148@tcp: import ffff9c2d3ebf6000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1789446181.670346:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2d41b7c000 x1876369794626432/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789446181.670369:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789446181.670372:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789446181.670560:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1876369794626560:0@lo:400:kworker.0 00000400:00000100:0.0:1789446181.670614:0:3657:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876369794626560 offset 0 length 224: 4 00000100:00100000:3.0:1789446181.671037:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3656:1876369794626432:0@lo:250:kworker.0 00000400:00000100:3.0:1789446181.671063:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876369794626432 offset 0 length 520: 4 00010000:00010000:3.0:1789446182.118791:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446183.143229:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446184.166612:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446185.190302:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789446185.766092:0:3656:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789446175/real 1789446175] req@ffff9c2d41b7d180 x1876369794626176/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789446185 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789446185.766126:0:3656:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c2d41b7d180 x1876369794626176/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789446185 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789446185.766157:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d3df28000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789446185.766176:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3656:1876369794626176:0@lo:39:umount.0 00000100:00080000:2.0:1789446185.766283:0:21238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789446185.766288:0:21238:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789446185.766293:0:21238:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789446185.768001:0:21238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9dc00/0x62554ff37454ffa1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff37454ffa8 expref: -99 pid: 18761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446185.768045:0:21238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9dc00/0x62554ff37454ffa1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff37454ffa8 expref: -99 pid: 18761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446185.768052:0:21238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9dc00/0x62554ff37454ffa1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff37454ffa8 expref: -99 pid: 18761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446185.768059:0:21238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9dc00/0x62554ff37454ffa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff37454ffa8 expref: -99 pid: 18761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446185.768090:0:21238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789446185.768098:0:21238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d42159400/0x62554ff374550305 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff37455030c expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446185.768104:0:21238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d42159400/0x62554ff374550305 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff37455030c expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446185.768120:0:21238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d42159400/0x62554ff374550305 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff37455030c expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446185.768127:0:21238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9c2d42159400/0x62554ff374550305 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff37455030c expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446185.768616:0:19710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446185.768624:0:19710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9dc00/0x62554ff37454ffa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff37454ffa8 expref: -99 pid: 18761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446185.768631:0:19710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9dc00 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:0.0:1789446185.768634:0:19710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9dc00/0x62554ff37454ffa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff37454ffa8 expref: -99 pid: 18761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446185.768642:0:19710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9dc00/0x62554ff37454ffa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x62554ff37454ffa8 expref: -99 pid: 18761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789446185.768649:0:19710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9dc00/0x62554ff37454ffa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x62554ff37454ffa8 expref: -99 pid: 18761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446185.768667:0:19710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789446185.768670:0:19710:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1789446185.768679:0:19710:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c2d3ebf6000 00010000:00010000:0.0:1789446185.768684:0:19710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9dc00/0x62554ff37454ffa1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x62554ff37454ffa8 expref: -99 pid: 18761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446185.768691:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9dc00/0x62554ff37454ffa1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x62554ff37454ffa8 expref: -99 pid: 18761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446185.768713:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446185.768715:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446185.768717:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446185.769338:0:21238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789446185.769347:0:21238:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1789446185.769351:0:21238:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789446185.769383:0:21238:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789446185.769387:0:21238:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789446185.769394:0:21238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789446185.769399:0:21238:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789446185.769415:0:21238:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9c2d2a253380) has no exports 00000020:00080000:2.0:1789446185.769437:0:21238:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9c2d2a253380) has no exports 00010000:00010000:0.0:1789446185.770427:0:17249:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446185.770439:0:17249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d42159400/0x62554ff374550305 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff37455030c expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446185.770468:0:17249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d42159400 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:0.0:1789446185.770472:0:17249:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d42159400/0x62554ff374550305 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff37455030c expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446185.770481:0:17249:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d42159400/0x62554ff374550305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x62554ff37455030c expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789446185.770487:0:17249:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d42159400/0x62554ff374550305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x62554ff37455030c expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446185.771761:0:17249:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789446185.771764:0:17249:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789446185.771768:0:17249:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789446185.771788:0:17249:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c2d3ebf6000 00010000:00010000:0.0:1789446185.771794:0:17249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d42159400/0x62554ff374550305 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x62554ff37455030c expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446185.771801:0:17249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d42159400/0x62554ff374550305 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x62554ff37455030c expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446185.771818:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446185.771820:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446185.771823:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789446185.776787:0:21238:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c2c08906b40 - data ffff9c2d41dcf288/ffff9c2c06554c00 00000020:01000000:2.0:1789446185.776927:0:21238:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c2d185ea120 - data ffff9c2d41dc4798/ffff9c2c05a26400 00100000:10000000:2.0:1789446185.792812:0:21238:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789446185.821781:0:21238:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454ffb6 00000020:00000080:1.0:1789446185.821797:0:21238:0:(genops.c:885:class_export_put()) final put ffff9c2d1030f000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789446185.821856:0:21238:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2c0756c000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789446185.821860:0:21238:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c2c0756c000 2 00000020:01000004:1.0:1789446185.821863:0:21238:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c2c0756c000 from lustre-OST0000 00000020:00000080:1.0:1789446185.821886:0:21238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789446185.821895:0:21238:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789446185.821898:0:21238:0:(genops.c:885:class_export_put()) final put ffff9c2d2fb00800/lustre-OST0000_UUID 00000020:00000080:1.0:1789446185.821900:0:21238:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d2fb00800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789446185.821907:0:21238:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1789446185.821983:0:21238:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789446185.821988:0:21238:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789446185.821991:0:21238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789446185.821996:0:21238:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789446185.822002:0:21238:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9c2c06784800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789446185.822009:0:21238:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff9c2d2fb4b380) has exports, disconnecting them 00000020:00080000:1.0:1789446185.822014:0:21238:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9c2c06784800), last request at 1789446104 00000020:00000080:1.0:1789446185.822018:0:21238:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454ffe0 00000020:00080000:1.0:1789446185.822041:0:21238:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2c06784800): rc 0 00000020:00000080:1.0:1789446185.822056:0:21238:0:(genops.c:885:class_export_put()) final put ffff9c2c06784800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789446185.822726:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d1030f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789446185.824282:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c06784800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789446185.830276:0:21238:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789446185.830286:0:21238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789446185.830290:0:21238:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789446185.830312:0:21238:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789446185.830516:0:21238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789446185.830524:0:21238:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1789446185.830532:0:21238:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789446185.830538:0:21238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789446185.830552:0:21238:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789446185.830559:0:21238:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9c2d3df2d800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789446185.830566:0:21238:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff9c2d35f48000) has exports, disconnecting them 00000020:00080000:0.0:1789446185.830571:0:21238:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9c2d3df2d800), last request at 1789446104 00000020:00000080:0.0:1789446185.830575:0:21238:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fff5 00000020:00080000:0.0:1789446185.830595:0:21238:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2d3df2d800): rc 0 00000020:00000080:2.0:1789446185.830599:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d31d3c000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789446185.830601:0:21238:0:(genops.c:885:class_export_put()) final put ffff9c2d3df2d800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1789446185.830607:0:37:0:(genops.c:885:class_export_put()) final put ffff9c2c079a3800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1789446185.830609:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c079a3800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1789446185.830619:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1789446185.830675:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3df2d800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1789446185.850256:0:21238:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789446185.850264:0:21238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789446185.850269:0:21238:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789446185.850275:0:21238:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789446185.850303:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d3df28000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1789446185.850472:0:21238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789446185.850495:0:21238:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1789446185.850501:0:21238:0:(genops.c:885:class_export_put()) final put ffff9c2d3df2d000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1789446185.850506:0:21238:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3df2d000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1789446185.850511:0:21238:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1789446185.850584:0:21238:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c2c0756c000 1 00000020:00000080:2.0:1789446185.850590:0:21238:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454ff93 00000020:00000080:2.0:1789446185.850596:0:21238:0:(genops.c:885:class_export_put()) final put ffff9c2d3fe24800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789446185.850606:0:21238:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789446185.850617:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3fe24800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789446185.850632:0:21238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789446185.850640:0:21238:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789446185.850644:0:21238:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff9c2d2a2519c0) has no exports 00000020:00000080:2.0:1789446185.974918:0:21238:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789446185.974941:0:21238:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789446185.974946:0:21238:0:(genops.c:885:class_export_put()) final put ffff9c2c0756e800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789446185.974951:0:21238:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c0756e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789446185.974980:0:21238:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789446185.975083:0:21238:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c2c0756a000 00000020:02000400:2.0:1789446185.975121:0:21238:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1789446186.214673:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789446186.726837:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2c2066a7-cdc1-4793-80dc-4607cc2d2086->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789446186.726848:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2c2066a7-cdc1-4793-80dc-4607cc2d2086->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789446186.726852:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789446186.726855:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789446186.726993:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789446186.727025:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1876369794626688:0@lo:400:kworker.0 00000400:00000100:2.0:1789446186.727081:0:3657:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876369794626688 offset 0 length 224: 4 00000100:00000400:3.0:1789446187.251621:0:3659:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789446171/real 1789446171] req@ffff9c2c07a91c00 x1876369794626048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789446187 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1789446187.253031:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789446187.284492:0:3659:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9c2c07a91c00 x1876369794626048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789446187 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789446187.284508:0:3659:0:(import.c:65:import_set_state_nolock()) ffff9c2c05bca000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789446187.284512:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789446187.295969:0:3659:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1789446187.296461:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2c2066a7-cdc1-4793-80dc-4607cc2d2086->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789446187.296468:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2c2066a7-cdc1-4793-80dc-4607cc2d2086->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789446187.296470:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789446187.296473:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789446187.296475:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789446187.296478:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789446187.296482:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c2c05bca000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789446187.296489:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 500 00000100:00080000:1.0:1789446187.296505:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9c2c05bca000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1789446187.296549:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2c082d3100 x1876369794626816/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789446187.296609:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1876369794626048:0@lo:400:kworker.0 00000100:00100000:2.0:1789446187.297038:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3656:1876369794626816:0@lo:38:kworker.0 00000400:00000100:2.0:1789446187.297085:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876369794626816 offset 0 length 520: 4 00010000:00010000:0.0:1789446188.264716:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446189.287580:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789446189.914714:0:21440:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789446189.937613:0:21440:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789446189.937694:0:21440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba7e00/0x62554ff374550065 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff37455006c expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446189.937709:0:21440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba7e00/0x62554ff374550065 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff37455006c expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446189.937717:0:21440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba7e00/0x62554ff374550065 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff37455006c expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446189.937740:0:21440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba7e00/0x62554ff374550065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff37455006c expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446189.937770:0:21440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789446189.937775:0:21440:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789446189.937810:0:21440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789446189.937821:0:21440:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2c07a90380 x1876369794625920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789446191 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1789446189.937905:0:19710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789446189.937911:0:19710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba7e00/0x62554ff374550065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff37455006c expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446189.937919:0:19710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d13ba7e00 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:2.0:1789446189.937922:0:19710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba7e00/0x62554ff374550065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff37455006c expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446189.937931:0:19710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba7e00/0x62554ff374550065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x62554ff37455006c expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789446189.937938:0:19710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba7e00/0x62554ff374550065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x62554ff37455006c expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789446189.937944:0:19710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789446189.937946:0:19710:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789446189.937949:0:19710:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789446189.938006:0:19710:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c2d3ebf6000 00010000:00010000:2.0:1789446189.938010:0:19710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba7e00/0x62554ff374550065 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x62554ff37455006c expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446189.938017:0:19710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba7e00/0x62554ff374550065 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x62554ff37455006c expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446189.938029:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446189.938030:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446189.938032:0:19710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446189.938233:0:21440:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789446189.938240:0:21440:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789446189.938246:0:21440:0:(import.c:65:import_set_state_nolock()) ffff9c2c079a1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789446189.938251:0:21440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789446189.938256:0:21440:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2c07a90380 x1876369794625920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789446191 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446189.943900:0:21440:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789446189.953084:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1876369794625920:0@lo:38:kworker.0 00000100:00100000:0.0:1789446189.953440:0:21440:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789446189.954485:0:21440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789446189.954497:0:21440:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2d41b7f480 x1876369794626304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446192 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446189.954575:0:21440:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2d41b7e680 x1876369794626560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446197 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446189.954628:0:21440:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2d2fa3d880 x1876369794626688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446202 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446189.954637:0:21440:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2c082d3100 x1876369794626816/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789446197 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446189.954646:0:21440:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789446189.954664:0:21440:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789446189.954669:0:21440:0:(import.c:65:import_set_state_nolock()) ffff9c2c05bca000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789446189.954674:0:21440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789446189.954678:0:21440:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2d41b7f480 x1876369794626304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446192 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446189.956424:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1876369794626560:0@lo:400:kworker.0 00000100:00100000:3.0:1789446189.958136:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1876369794626304:0@lo:400:kworker.0 00000100:00100000:0.0:1789446189.958194:0:21440:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2d41b7e680 x1876369794626560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446197 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446189.958206:0:21440:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2d2fa3d880 x1876369794626688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446202 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446189.958215:0:21440:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2c082d3100 x1876369794626816/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789446197 ref 1 fl Interpret:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446189.958224:0:21440:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789446189.958269:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3656:1876369794626816:0@lo:38:kworker.0 00000100:00100000:2.0:1789446189.959979:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1876369794626688:0@lo:400:kworker.0 00000100:00100000:0.0:1789446189.962265:0:21440:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789446189.964468:0:21440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36806800/0x62554ff37455003b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550042 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446189.964487:0:21440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36806800/0x62554ff37455003b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff374550042 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446189.964493:0:21440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36806800/0x62554ff37455003b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff374550042 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446189.964499:0:21440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9c2d36806800/0x62554ff37455003b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff374550042 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446189.964575:0:21440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789446189.964583:0:21440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d42159200/0x62554ff3745502f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745502fe expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446189.964605:0:21440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d42159200/0x62554ff3745502f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff3745502fe expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446189.964611:0:21440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d42159200/0x62554ff3745502f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff3745502fe expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446189.964617:0:21440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9c2d42159200/0x62554ff3745502f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x62554ff3745502fe expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446189.967662:0:17249:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789446189.967674:0:17249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d36806800/0x62554ff37455003b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff374550042 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446189.967685:0:17249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36806800 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:2.0:1789446189.967689:0:17249:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d36806800/0x62554ff37455003b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff374550042 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446189.967700:0:17249:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d36806800/0x62554ff37455003b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x62554ff374550042 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789446189.967708:0:17249:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d36806800/0x62554ff37455003b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x62554ff374550042 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789446189.967713:0:17249:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789446189.967716:0:17249:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1789446189.967727:0:17249:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c2d3ebf6000 00010000:00010000:2.0:1789446189.967745:0:17249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d36806800/0x62554ff37455003b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x62554ff374550042 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446189.967752:0:17249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d36806800/0x62554ff37455003b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x62554ff374550042 expref: -99 pid: 19579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446189.967768:0:17249:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789446189.967774:0:17249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d42159200/0x62554ff3745502f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff3745502fe expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446189.967781:0:17249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d42159200 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:2.0:1789446189.967784:0:17249:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d42159200/0x62554ff3745502f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x62554ff3745502fe expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446189.967802:0:17249:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d42159200/0x62554ff3745502f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x62554ff3745502fe expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789446189.967808:0:17249:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d42159200/0x62554ff3745502f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x62554ff3745502fe expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789446189.967813:0:17249:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789446189.967815:0:17249:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1789446189.967820:0:17249:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c2d3ebf6000 00010000:00010000:2.0:1789446189.967822:0:17249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d42159200/0x62554ff3745502f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x62554ff3745502fe expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446189.967829:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446189.967830:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446189.967832:0:17249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446189.967914:0:21440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789446189.967921:0:21440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d42159200/0x62554ff3745502f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x62554ff3745502fe expref: -99 pid: 17258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446189.967937:0:21440:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1789446189.967943:0:21440:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1789446189.967945:0:21440:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1789446189.968063:0:21440:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1789446189.968068:0:21440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1789446189.968074:0:21440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789446189.968078:0:21440:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789446189.968083:0:21440:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9c2c069e4d40) has no exports 00000020:00080000:0.0:1789446189.968105:0:21440:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9c2c069e4d40) has no exports 00010000:00010000:2.0:1789446189.969128:0:17250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789446189.970513:0:21440:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c2c08906420 - data ffff9c2d41c761b0/ffff9c2d315e3800 00000020:01000000:0.0:1789446189.970677:0:21440:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c2d3eddca20 - data ffff9c2d2033d438/ffff9c2c06555400 00100000:10000000:0.0:1789446189.982542:0:21440:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789446189.989714:0:21440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff374550050 00000020:00000080:0.0:1789446189.989725:0:21440:0:(genops.c:885:class_export_put()) final put ffff9c2c05bca800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789446189.989745:0:21440:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2d10308000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789446189.989748:0:21440:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c2d10308000 2 00000020:01000004:0.0:1789446189.989761:0:21440:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c2d10308000 from lustre-OST0001 00000020:00000080:0.0:1789446189.989782:0:21440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789446189.989801:0:21440:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789446189.989805:0:21440:0:(genops.c:885:class_export_put()) final put ffff9c2c05bcb800/lustre-OST0001_UUID 00000020:00000080:0.0:1789446189.989807:0:21440:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c05bcb800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789446189.989813:0:21440:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789446189.989891:0:21440:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 2c2066a7-cdc1-4793-80dc-4607cc2d2086->MGS 00010000:00010000:0.0:1789446189.989905:0:21440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff37454fe5f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x62554ff37454fe66 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789446189.989917:0:21440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff37454fe5f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x62554ff37454fe66 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446189.989924:0:21440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789446189.989927:0:21440:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789446189.989930:0:21440:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789446189.989943:0:21440:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c2d3ebf6000 00010000:00010000:0.0:1789446189.989947:0:21440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff37454fe5f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x62554ff37454fe66 expref: -99 pid: 17991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789446189.990098:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c05bca800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:0.0:1789446189.990154:0:21440:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba6600/0x62554ff37454fd4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x62554ff37454fd55 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789446189.990162:0:21440:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba6600/0x62554ff37454fd4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x62554ff37454fd55 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446189.990167:0:21440:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789446189.990170:0:21440:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789446189.990172:0:21440:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789446189.990182:0:21440:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c2d3ebf6000 00010000:00010000:0.0:1789446189.990185:0:21440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba6600/0x62554ff37454fd4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x62554ff37454fd55 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789446189.990212:0:21440:0:(import.c:65:import_set_state_nolock()) ffff9c2d3ebf6000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789446189.990216:0:21440:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789446189.990218:0:21440:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789446189.990220:0:21440:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789446189.990224:0:21440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789446189.990234:0:21440:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2d41b7c000 x1876369794626432/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789446196 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789446189.990258:0:21440:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789446189.990261:0:21440:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:2.0:1789446189.990320:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2c2066a7-cdc1-4793-80dc-4607cc2d2086:3656:1876369794626432:0@lo:250:kworker.0 10000000:01000000:0.0:1789446189.990493:0:21440:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789446189.990499:0:21440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37454fd39 00000020:00000080:0.0:1789446189.990505:0:21440:0:(genops.c:885:class_export_put()) final put ffff9c2d3ebf5800/2c2066a7-cdc1-4793-80dc-4607cc2d2086 00000020:01000000:0.0:1789446189.990511:0:21440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.148@tcp (flags='') 00000020:00000080:0.0:1789446189.990515:0:21440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789446189.990520:0:21440:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.148@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789446189.990533:0:21440:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9c2c0667cd40) has no exports 00000020:00000080:2.0:1789446189.990579:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3ebf5800/2c2066a7-cdc1-4793-80dc-4607cc2d2086 for MGC192.168.206.148@tcp 10000000:01000000:3.0:1789446189.990630:0:17258:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789446189.992935:0:21440:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.148@tcp: client import never connected 00000100:00080000:0.0:1789446189.992943:0:21440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789446189.992946:0:21440:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789446189.992950:0:21440:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789446189.992953:0:21440:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789446189.993021:0:21440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789446189.993029:0:21440:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.148@tcp (uuid 2c2066a7-cdc1-4793-80dc-4607cc2d2086) 00000020:01000000:0.0:1789446189.993038:0:21440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789446189.993042:0:21440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789446189.993047:0:21440:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789446189.993053:0:21440:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9c2c079a2000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789446189.993060:0:21440:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff9c2d3d094d40) has exports, disconnecting them 00000020:00080000:0.0:1789446189.993065:0:21440:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9c2c079a2000), last request at 1789446118 00000020:00000080:0.0:1789446189.993069:0:21440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37455007a 00000020:00080000:0.0:1789446189.993096:0:21440:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2c079a2000): rc 0 00000020:00000080:0.0:1789446189.993100:0:21440:0:(genops.c:885:class_export_put()) final put ffff9c2c079a2000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789446189.993760:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2d3ebf6000 for MGC192.168.206.148@tcp 00000020:00000080:2.0:1789446189.993768:0:37:0:(genops.c:885:class_export_put()) final put ffff9c2d3ebf3800/2c2066a7-cdc1-4793-80dc-4607cc2d2086 00000020:00000080:2.0:1789446189.993771:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3ebf3800/2c2066a7-cdc1-4793-80dc-4607cc2d2086 for MGC192.168.206.148@tcp 00000020:01000000:2.0:1789446189.993776:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.148@tcp (2c2066a7-cdc1-4793-80dc-4607cc2d2086) 00000020:00000080:2.0:1789446189.994037:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c079a2000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789446190.016540:0:21440:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789446190.016550:0:21440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789446190.016554:0:21440:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789446190.016562:0:21440:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789446190.016759:0:21440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789446190.016768:0:21440:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1789446190.016775:0:21440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789446190.016779:0:21440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789446190.016784:0:21440:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00000080:2.0:1789446190.016880:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2c079a1800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789446190.016890:0:37:0:(genops.c:885:class_export_put()) final put ffff9c2d3df2f800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1789446190.016894:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3df2f800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1789446190.016903:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00080000:0.0:1789446190.017149:0:21440:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9c2c065d8000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789446190.017155:0:21440:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff9c2c069e3380) has exports, disconnecting them 00000020:00080000:0.0:1789446190.017159:0:21440:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9c2c065d8000), last request at 1789446118 00000020:00000080:0.0:1789446190.017163:0:21440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff37455008f 00000020:00080000:0.0:1789446190.017173:0:21440:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2c065d8000): rc 0 00000020:00000080:0.0:1789446190.017176:0:21440:0:(genops.c:885:class_export_put()) final put ffff9c2c065d8000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1789446190.017238:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c065d8000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1789446190.097122:0:21440:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789446190.097130:0:21440:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789446190.097134:0:21440:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789446190.097140:0:21440:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789446190.097201:0:19710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789446190.097341:0:17249:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1789446190.097408:0:17250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1789446190.097502:0:20290:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9c2c05ada200:20290] 2 exiting: rc = 0 00000100:00100000:0.0:1789446190.097649:0:17245:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9c2d2fb40c00:17245] 1 exiting: rc = 0 00000020:00000080:0.0:1789446190.097706:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c2c05bca000 for lustre-MDT0001-lwp-OST0001 00000100:00100000:0.0:1789446190.097743:0:17244:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9c2d207e6200:17244] 0 exiting: rc = 1 00000100:00100000:2.0:1789446190.097874:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.098559:0:17248:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9c2d2fb40600:17248] 2 exiting: rc = 0 00000100:00100000:0.0:1789446190.098619:0:17246:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9c2d2fb40800:17246] 0 exiting: rc = 1 00000100:00100000:0.0:1789446190.098690:0:17247:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9c2d2fb41c00:17247] 1 exiting: rc = 0 00000100:00100000:3.0:1789446190.099280:0:20289:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9c2c067b2200:20289] 3 exiting: rc = 0 00000100:00100000:2.0:1789446190.103933:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.103944:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.103950:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.103970:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.103978:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105119:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105127:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105143:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105148:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105154:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105159:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105164:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105170:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105176:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105181:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105187:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105191:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105196:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105202:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105207:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105212:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105217:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105222:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105228:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105233:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105237:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105243:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105249:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105253:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105258:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105263:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105268:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105272:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105277:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105281:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105286:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105290:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105295:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105300:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105305:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105310:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105315:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105341:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105346:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105351:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105356:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105361:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105365:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105370:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105375:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105380:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105386:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105391:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105396:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105402:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105407:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105412:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105417:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105422:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105428:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105432:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105437:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105442:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.105447:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789446190.108067:0:21440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789446190.108078:0:21440:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1789446190.108083:0:21440:0:(genops.c:885:class_export_put()) final put ffff9c2c05bcd000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1789446190.108088:0:21440:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2c05bcd000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1789446190.108092:0:21440:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1789446190.108137:0:21440:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c2d10308000 1 00000020:00000080:2.0:1789446190.108142:0:21440:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x62554ff374550034 00000020:00000080:2.0:1789446190.108148:0:21440:0:(genops.c:885:class_export_put()) final put ffff9c2d3df2e800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1789446190.108163:0:21440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1789446190.108167:0:21440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789446190.108171:0:21440:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789446190.108174:0:21440:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff9c2c06a94d40) has no exports 00000020:00000080:0.0:1789446190.113468:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3df2e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789446190.176289:0:21440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789446190.176302:0:21440:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1789446190.176307:0:21440:0:(genops.c:885:class_export_put()) final put ffff9c2d2fb02000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1789446190.176312:0:21440:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d2fb02000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789446190.177402:0:21440:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1789446190.178590:0:21440:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c2d1030b800 00000020:01000000:2.0:1789446190.178614:0:21440:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1789446190.178619:0:21440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789446190.178624:0:21440:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789446190.178628:0:21440:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff9c2d35f4b380) has no exports 00000020:00000080:2.0:1789446190.178675:0:21440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789446190.178684:0:21440:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1789446190.178688:0:21440:0:(genops.c:885:class_export_put()) final put ffff9c2d3fe20000/OSS_uuid 00000020:00000080:2.0:1789446190.178691:0:21440:0:(genops.c:844:class_export_destroy()) destroying export ffff9c2d3fe20000/OSS_uuid for OSS 00000020:01000000:2.0:1789446190.178697:0:21440:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1789446190.178788:0:18767:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9c2d317cb800:18767] 2 exiting: rc = 0 00000100:00100000:2.0:1789446190.178878:0:19357:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9c2d2fb16600:19357] 3 exiting: rc = 0 00000100:00100000:1.0:1789446190.180566:0:19708:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff9c2c06a68800:19708] 4 exiting: rc = 0 00000100:00100000:1.0:1789446190.180701:0:18766:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9c2d13352600:18766] 1 exiting: rc = 0 00000100:00100000:1.0:1789446190.180794:0:18765:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9c2d13352400:18765] 0 exiting: rc = 1 00000100:00100000:1.0:1789446190.180860:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.180868:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.180873:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.180879:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.180884:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.180889:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.180894:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.180913:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.180918:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.180924:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.180929:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.180934:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.180939:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.180944:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.180950:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.180954:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.180979:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181111:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181118:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181122:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181128:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181132:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181138:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181144:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181149:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181154:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181159:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181165:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181170:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181175:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181180:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181185:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181189:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181194:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181199:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181204:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181208:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181213:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181218:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181223:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181227:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181231:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181243:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181248:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181253:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181258:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181263:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181269:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181274:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181279:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181283:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181287:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181292:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181296:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181301:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181307:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181312:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181393:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181401:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181406:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181410:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181415:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181421:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.181427:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:0.0:1789446190.181843:0:17257:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789446190.189532:0:18770:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9c2d317caa00:18770] 1 exiting: rc = 0 00000100:00100000:0.0:1789446190.190308:0:18769:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9c2d2fb11e00:18769] 0 exiting: rc = 1 00000100:00100000:1.0:1789446190.190465:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190473:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190480:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190484:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190489:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190495:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190499:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190504:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190510:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190515:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190530:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190536:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190541:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190561:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190566:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190571:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190576:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190580:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190599:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190606:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190611:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190616:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190620:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190625:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190629:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190634:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190638:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190643:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190647:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.190651:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191477:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191489:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191494:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191499:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191505:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191509:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191514:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191528:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191535:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191541:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191546:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191551:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191556:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191561:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191565:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191570:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191575:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191580:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191594:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191599:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191604:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191609:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191613:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191619:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191624:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191629:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191634:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191638:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191643:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191648:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191652:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191668:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191674:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.191685:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789446190.197578:0:18772:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9c2d40d8ce00:18772] 1 exiting: rc = 0 00000100:00100000:1.0:1789446190.197914:0:18771:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9c2d40d8d200:18771] 0 exiting: rc = 1 00000100:00100000:2.0:1789446190.198175:0:20404:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9c2d41b60800:20404] 3 exiting: rc = 0 00000100:00100000:3.0:1789446190.205252:0:18773:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9c2d40d8cc00:18773] 2 exiting: rc = 0 00000100:00100000:1.0:1789446190.214575:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214598:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214605:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214611:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214616:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214622:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214627:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214632:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214637:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214642:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214660:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214667:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214672:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214677:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214683:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214688:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214694:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214699:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214720:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214726:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214801:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214808:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214813:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214818:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214823:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214828:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214834:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214839:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214844:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214850:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214855:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214861:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214866:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214872:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214895:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214902:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214909:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214915:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214921:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214926:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214932:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214937:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214943:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214948:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214971:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.214979:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.215054:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.215060:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.215065:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.215071:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.215077:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.215082:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.215087:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.215099:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.215104:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.215111:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.215116:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.215122:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.215127:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.215132:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.215138:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.215143:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.215148:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.215153:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789446190.231454:0:18774:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9c2c018f7a00:18774] 0 exiting: rc = 1 00000100:00100000:2.0:1789446190.231573:0:18775:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9c2c067ffa00:18775] 1 exiting: rc = 0 00000100:00100000:1.0:1789446190.234648:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234667:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234678:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234685:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234690:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234695:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234700:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234704:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234710:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234715:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234719:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234724:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234740:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234746:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234751:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234755:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234760:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234764:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234769:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234774:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234778:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234782:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234795:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234801:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234817:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234822:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234827:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234832:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234837:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234842:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234847:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234851:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234856:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234860:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234865:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234870:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234875:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234880:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234885:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234889:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234895:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234900:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234905:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234910:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234915:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234920:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234925:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234930:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234934:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234939:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234945:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.234950:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.235249:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.235257:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.235261:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.235265:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.235271:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.235275:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.235280:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.235292:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.235298:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.235303:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.235308:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789446190.235332:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.237065:0:18776:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9c2c05a33000:18776] 0 exiting: rc = 1 00000100:00100000:1.0:1789446190.238383:0:18777:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9c2c067fea00:18777] 1 exiting: rc = 0 00000100:00100000:0.0:1789446190.238539:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238555:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238591:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238598:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238604:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238610:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238616:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238622:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238628:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238634:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238640:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238645:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238651:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238721:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238841:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238848:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238855:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238860:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238867:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238873:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238879:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238884:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238889:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238894:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238899:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238904:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238922:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238929:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238934:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238940:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238946:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.238951:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239178:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239185:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239191:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239198:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239204:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239218:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239238:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239248:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239254:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239260:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239265:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239271:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239276:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239282:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239287:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239294:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239299:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239304:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239389:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239396:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239401:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239406:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239411:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239416:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239421:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239426:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239431:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239437:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239442:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239448:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239454:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789446190.239468:0:21440:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1789446190.263490:0:21440:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1789446213.502520:0:22204:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789446223.870877:0:22803:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789446223.870884:0:22803:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1789446223.870885:0:22803:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789446223.871281:0:22803:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c2d41bbc000 00000020:01000004:2.0:1789446223.871296:0:22803:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789446223.871303:0:22803:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789446223.871317:0:22803:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c2d2fb4b380) 00000020:00000080:2.0:1789446223.871329:0:22803:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789446223.976002:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1789446223.981069:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789446223.984368:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1789446223.985522:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1789446223.988999:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1789446223.989329:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789446223.989733:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1789446223.990533:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1789446223.991309:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1789446223.991748:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1789446223.994153:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1789446223.994744:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789446223.994948:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1789446223.995314:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1789446223.995720:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1789446223.996267:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789446223.996806:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1789446223.997487:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1789446223.998791:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789446224.000220:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789446224.000727:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789446224.000937:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789446224.001163:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789446224.001530:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1789446224.001836:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1789446224.002126:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789446224.003662:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789446224.003982:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789446224.004228:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1789446224.004683:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789446224.005527:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1789446224.006047:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789446224.006579:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789446224.008015:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1789446224.008302:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789446224.011340:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789446224.013192:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1789446224.013686:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789446224.013999:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1789446224.014299:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789446224.014684:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789446224.014937:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1789446224.015286:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789446224.018065:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789446224.018722:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789446224.018953:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1789446224.019388:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1789446224.025065:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1789446224.025901:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1789446224.026356:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1789446224.026943:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1789446224.027249:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1789446224.027582:0:22803:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:3.0:1789446224.028725:0:22803:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789446224.028926:0:22803:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789446224.028933:0:22803:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789446224.028945:0:22803:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x62554ff3745505ac 00000020:01000004:3.0:1789446224.028951:0:22803:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1789446224.029053:0:22803:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789446224.029060:0:22803:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c2d41bbc000 from MGS 00000020:01000004:3.0:1789446224.029063:0:22803:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789446224.029072:0:22803:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c2d3d093380) 00000020:00000080:3.0:1789446224.029084:0:22803:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789446224.029141:0:22803:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2d41bbc000 from MGS, refs=2 00080000:01000000:3.0:1789446224.029146:0:22803:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789446224.029150:0:22803:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x62554ff3745505ba 00000100:00100000:3.0:1789446224.029261:0:22803:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789446224.029406:0:22803:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789446224.029413:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789446224.030104:0:22803:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789446224.030112:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789446224.031242:0:22803:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789446224.031710:0:22803:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789446224.031717:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789446224.032206:0:22803:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789446224.032213:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789446224.032770:0:22803:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789446224.032776:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789446224.033377:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446224.033380:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446224.033382:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446224.033858:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446224.033861:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446224.033863:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446224.034776:0:22803:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789446224.039319:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789446224.040669:0:22803:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1789446224.041704:0:22815:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789446224.041752:0:22803:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789446224.041793:0:22803:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789446224.042491:0:22803:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789446224.042908:0:22803:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789446224.043197:0:22803:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789446224.043203:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789446224.048075:0:22803:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789446224.048087:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789446224.052178:0:22803:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789446224.052190:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789446224.053147:0:22803:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789446224.053167:0:22803:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.148@tcp' 00000020:01000004:1.0:1789446224.053169:0:22803:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789446224.053196:0:22803:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.148@tcp (typ=mgc) 00000020:00000080:1.0:1789446224.053208:0:22803:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.148@tcp (ffff9c2c069e0000) 00000020:00000080:1.0:1789446224.053222:0:22803:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789446224.053293:0:22803:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2c05b60000@MGC192.168.206.148@tcp: add connection 192.168.206.148@tcp at head 00010000:00010000:1.0:1789446224.053781:0:22803:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.148@tcp-0 is initialized 00000040:01000000:1.0:1789446224.053787:0:22803:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 1 is initialized 10000000:01000000:1.0:1789446224.054243:0:22821:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789446224.054316:0:22803:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.148@tcp (uuid 282408b2-7484-4ad3-93ba-27093493daa8) 00000020:00000080:0.0:1789446224.054333:0:22803:0:(genops.c:1384:class_connect()) connect: client 282408b2-7484-4ad3-93ba-27093493daa8, cookie 0x62554ff3745505c8 00000100:00080000:0.0:1789446224.054343:0:22803:0:(import.c:545:import_select_connection()) MGC192.168.206.148@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789446224.054351:0:22803:0:(import.c:666:import_select_connection()) MGC192.168.206.148@tcp: import ffff9c2c05b60000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789446224.054391:0:22803:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2d2fa3f100 x1876369794626944/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789446224.054426:0:22803:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 282408b2-7484-4ad3-93ba-27093493daa8->MGS 00000020:01000004:0.0:1789446224.054445:0:22803:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789446224.054450:0:22803:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789446224.054461:0:22803:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9c2c06a93380) 00000020:00000080:0.0:1789446224.054469:0:22803:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789446224.054611:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:282408b2-7484-4ad3-93ba-27093493daa8:3656:1876369794626944:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789446224.054670:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446224.054729:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794626944 00000100:00100000:1.0:1789446224.054736:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794626944 00000100:00100000:1.0:1789446224.054764:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789446224.054770:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3656:x1876369794626944:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789446224.054790:0:22816:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 282408b2-7484-4ad3-93ba-27093493daa8@0@lo t0 exp 0000000000000000 cur 606 last 0 00000020:00000080:1.0:1789446224.054809:0:22816:0:(genops.c:1384:class_connect()) connect: client 282408b2-7484-4ad3-93ba-27093493daa8, cookie 0x62554ff3745505d6 00000100:00080000:1.0:1789446224.054935:0:22816:0:(import.c:65:import_set_state_nolock()) ffff9c2c05b61000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789446224.055000:0:22820:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1789446224.055006:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+5:3656:x1876369794626944:12345-0@lo:250:mount.lustre.0 Request processed in 234us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446224.055012:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789446224.055048:0:3656:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.148@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789446224.055055:0:3656:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.148@tcp: connect to target with instance 0 00000100:00080000:1.0:1789446224.055061:0:3656:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789446224.055066:0:3656:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789446224.055069:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2c05b60000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789446224.055071:0:3656:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789446224.055085:0:3656:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789446224.055091:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:282408b2-7484-4ad3-93ba-27093493daa8:3656:1876369794626944:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789446224.068382:0:22803:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789446224.068748:0:22803:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789446224.068755:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789446224.071611:0:22803:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789446224.071628:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789446224.076336:0:22803:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789446224.076350:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789446224.078780:0:22803:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789446224.079148:0:22803:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789446224.079154:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789446224.080108:0:22803:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789446224.080116:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789446224.118378:0:22803:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789446224.118760:0:22803:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789446224.118766:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789446224.119887:0:22803:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789446224.119898:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789446224.121169:0:22803:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789446224.121343:0:22803:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789446224.121349:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789446224.122105:0:22803:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789446224.122118:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789446224.122784:0:22803:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789446224.122919:0:22803:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789446224.122924:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789446224.123489:0:22803:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789446224.123497:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789446224.124211:0:22803:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789446224.124374:0:22803:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789446224.124380:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789446224.125250:0:22803:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789446224.125258:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789446224.141721:0:22803:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789446224.141922:0:22803:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789446224.141929:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789446224.144020:0:22803:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789446224.144032:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789446224.145144:0:22803:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789446224.145155:0:22803:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789446224.146353:0:22803:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789446224.147298:0:22803:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1789446224.147306:0:22803:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789446224.147423:0:22803:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789446224.147465:0:22803:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.148@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789446224.147469:0:22803:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789446224.147471:0:22803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789446224.147472:0:22803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789446224.147474:0:22803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789446224.147475:0:22803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789446224.147476:0:22803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789446224.147477:0:22803:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789446224.147479:0:22803:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789446224.147481:0:22803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789446224.147482:0:22803:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789446224.147485:0:22803:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789446224.147487:0:22803:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789446224.147488:0:22803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789446224.147489:0:22803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789446224.147490:0:22803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789446224.147491:0:22803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789446224.147492:0:22803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789446224.147493:0:22803:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789446224.147495:0:22803:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789446224.147496:0:22803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789446224.147501:0:22803:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789446224.147526:0:22803:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789446224.147544:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794627072:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789446224.147782:0:22803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446224.147897:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067ef480 going to sleep for 11 seconds 00000100:00100000:3.0:1789446224.148030:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794627072 00000100:00100000:3.0:1789446224.148038:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794627072 00000100:00100000:3.0:1789446224.148246:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789446224.148265:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+5:22803:x1876369794627072:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789446224.148313:0:22819:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789446224.148316:0:22819:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789446224.148318:0:22819:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789446224.149124:0:22840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789446224.149579:0:22819:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1789446224.151489:0:22841:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789446224.151495:0:22841:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1789446224.151499:0:22841:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789446224.151502:0:22841:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789446224.151803:0:22841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1789446224.152413:0:22819:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789446224.152424:0:22819:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789446224.154437:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+5:22803:x1876369794627072:12345-0@lo:253:mount.lustre.0 Request processed in 6165us (6646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446224.154455:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789446224.154712:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794627072:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789446224.154728:0:22803:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789446224.154731:0:22803:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789446224.154733:0:22803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789446224.154734:0:22803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789446224.154735:0:22803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789446224.154736:0:22803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789446224.154738:0:22803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789446224.154739:0:22803:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789446224.154740:0:22803:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789446224.154742:0:22803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789446224.154743:0:22803:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789446224.154761:0:22803:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c2d41bbc000 from lustre-MDT0000 10000000:01000000:0.0:1789446224.154792:0:22803:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789446224.154796:0:22803:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789446224.154799:0:22803:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c2c069e0000 10000000:01000000:0.0:1789446224.154803:0:22803:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789446224.154810:0:22803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c2c069e0000 from 1 10000000:01000000:0.0:1789446224.154813:0:22803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789446224.154848:0:22803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50400/0x62554ff3745505dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446224.154858:0:22803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50400/0x62554ff3745505dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446224.154868:0:22803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50400/0x62554ff3745505dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446224.154886:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794627200:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789446224.154933:0:22803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446224.155134:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067ef6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789446224.155175:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794627200 00000100:00100000:1.0:1789446224.155181:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794627200 00000100:00100000:1.0:1789446224.155226:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789446224.155235:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+5:22803:x1876369794627200:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789446224.155246:0:22818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446224.155260:0:22818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d00031c00/0x62554ff3745505e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff3745505dd expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446224.155282:0:22818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d00031c00/0x62554ff3745505e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff3745505dd expref: 6 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446224.155292:0:22818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d00031c00/0x62554ff3745505e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff3745505dd expref: 6 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446224.155301:0:22818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d00031c00, rc 0) 00000100:00100000:1.0:1789446224.155409:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+6:22803:x1876369794627200:12345-0@lo:101:mount.lustre.0 Request processed in 164us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446224.155422:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789446224.155706:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794627200:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789446224.155721:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50400/0x62554ff3745505dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745505e4 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446224.155729:0:22803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50400/0x62554ff3745505dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff3745505e4 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446224.155785:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794627328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789446224.155813:0:22803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446224.155878:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d207c4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789446224.155922:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794627328 00000100:00100000:3.0:1789446224.155927:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794627328 00000100:00100000:3.0:1789446224.156033:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789446224.156042:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+6:22803:x1876369794627328:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789446224.156125:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+6:22803:x1876369794627328:12345-0@lo:501:mount.lustre.0 Request processed in 84us (310us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789446224.156131:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789446224.156219:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794627328:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789446224.156244:0:22803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789446224.156265:0:22803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50400/0x62554ff3745505dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745505e4 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446224.156274:0:22803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50400/0x62554ff3745505dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745505e4 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789446224.156282:0:22803:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c2d41bbc000 10000000:01000000:2.0:1789446224.156293:0:22803:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789446224.156297:0:22803:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c2d41bbc000 10000000:01000000:2.0:1789446224.156300:0:22803:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789446224.156302:0:22803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c2d41bbc000 from 1 10000000:01000000:2.0:1789446224.156305:0:22803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789446224.156325:0:22803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6a00/0x62554ff3745505eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446224.156331:0:22803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6a00/0x62554ff3745505eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446224.156338:0:22803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6a00/0x62554ff3745505eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446224.156349:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794627456:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789446224.156386:0:22803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446224.156592:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d207c4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789446224.156777:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794627456 00000100:00100000:1.0:1789446224.156783:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794627456 00000100:00100000:1.0:1789446224.156812:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789446224.156819:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+6:22803:x1876369794627456:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789446224.156829:0:22818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446224.156843:0:22818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d00030600/0x62554ff3745505f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff3745505eb expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446224.156863:0:22818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d00030600/0x62554ff3745505f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff3745505eb expref: 7 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446224.156872:0:22818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d00030600/0x62554ff3745505f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff3745505eb expref: 7 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446224.156880:0:22818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d00030600, rc 0) 00000100:00100000:1.0:1789446224.156923:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+7:22803:x1876369794627456:12345-0@lo:101:mount.lustre.0 Request processed in 104us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446224.156929:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789446224.157042:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794627456:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789446224.157054:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6a00/0x62554ff3745505eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745505f2 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446224.157061:0:22803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6a00/0x62554ff3745505eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff3745505f2 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789446224.157074:0:22803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789446224.157090:0:22803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6a00/0x62554ff3745505eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745505f2 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446224.157097:0:22803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6a00/0x62554ff3745505eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745505f2 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789446224.157114:0:22803:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789446224.157117:0:22803:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789446224.157122:0:22803:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c2d41bbc000 10000000:01000000:2.0:1789446224.157124:0:22803:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789446224.157128:0:22803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789446224.157130:0:22803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789446224.157144:0:22803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7800/0x62554ff3745505f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446224.157151:0:22803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7800/0x62554ff3745505f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446224.157157:0:22803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7800/0x62554ff3745505f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446224.157169:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794627584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789446224.157195:0:22803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446224.157213:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d207c4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789446224.157266:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794627584 00000100:00100000:1.0:1789446224.157270:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794627584 00000100:00100000:1.0:1789446224.157286:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789446224.157290:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+7:22803:x1876369794627584:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789446224.157297:0:22818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446224.157304:0:22818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d00031000/0x62554ff374550600 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff3745505f9 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446224.157317:0:22818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d00031000/0x62554ff374550600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff3745505f9 expref: 8 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446224.157332:0:22818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d00031000/0x62554ff374550600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff3745505f9 expref: 8 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446224.157339:0:22818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d00031000, rc 0) 00000100:00100000:1.0:1789446224.157426:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+8:22803:x1876369794627584:12345-0@lo:101:mount.lustre.0 Request processed in 134us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446224.157431:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789446224.157809:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794627584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789446224.157823:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7800/0x62554ff3745505f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550600 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446224.157831:0:22803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7800/0x62554ff3745505f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff374550600 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446224.157891:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794627712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789446224.157918:0:22803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446224.158095:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d207c4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789446224.158152:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794627712 00000100:00100000:0.0:1789446224.158157:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794627712 00000100:00100000:1.0:1789446224.158206:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789446224.158214:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+8:22803:x1876369794627712:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789446224.158410:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+9:22803:x1876369794627712:12345-0@lo:501:mount.lustre.0 Request processed in 196us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446224.158417:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789446224.158797:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794627712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789446224.158830:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794627840:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789446224.158873:0:22803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446224.158937:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d207c4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789446224.159138:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794627840 00000100:00100000:3.0:1789446224.159144:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794627840 00000100:00100000:3.0:1789446224.159181:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789446224.159187:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+9:22803:x1876369794627840:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789446224.160050:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+9:22803:x1876369794627840:12345-0@lo:503:mount.lustre.0 Request processed in 860us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446224.160060:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789446224.160205:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794627840:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789446224.160758:0:22842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:282408b2-7484-4ad3-93ba-27093493daa8:22842:1876369794627968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789446224.160808:0:22842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446224.160882:0:22842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067ef840 going to sleep for 11 seconds 00000100:00100000:3.0:1789446224.160945:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794627968 00000100:00100000:3.0:1789446224.160952:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794627968 00000100:00100000:3.0:1789446224.161015:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789446224.161023:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+9:22842:x1876369794627968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789446224.161822:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+9:22842:x1876369794627968:12345-0@lo:502:llog_process_th.0 Request processed in 797us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446224.161831:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789446224.162052:0:22842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:282408b2-7484-4ad3-93ba-27093493daa8:22842:1876369794627968:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789446224.162082:0:22842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789446224.162093:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789446224.162095:0:22842:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789446224.162100:0:22842:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789446224.162103:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789446224.162117:0:22842:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c2c06a919c0) 00000020:00000080:0.0:1789446224.162133:0:22842:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789446224.162138:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789446224.162212:0:22842:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789446224.162219:0:22842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x62554ff37455060e 00000020:00000080:0.0:1789446224.162515:0:22842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789446224.162520:0:22842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789446224.162524:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789446224.162525:0:22842:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789446224.162528:0:22842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789446224.162531:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789446224.162533:0:22842:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789446224.162535:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789446224.162543:0:22842:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c2c06a90000) 00000020:00000080:0.0:1789446224.162553:0:22842:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789446224.162699:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789446224.162702:0:22842:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789446224.162705:0:22842:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789446224.162714:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789446224.162780:0:22842:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2d41bbc000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789446224.162794:0:22842:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c2c06a94d40) 00000020:00000080:0.0:1789446224.162803:0:22842:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789446224.162864:0:22842:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789446224.162870:0:22842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x62554ff374550623 00000020:00000080:0.0:1789446224.163085:0:22842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789446224.163092:0:22842:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789446224.163097:0:22842:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x62554ff37455062a 00080000:01000000:0.0:1789446224.163103:0:22842:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789446224.163107:0:22842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x62554ff374550631 00010000:00010000:0.0:1789446224.230745:0:22842:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1789446224.231382:0:22842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:0.0:1789446224.231912:0:22842:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789446224.232549:0:22842:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c2d35f4b380) 00000020:00000080:0.0:1789446224.232580:0:22842:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789446224.232660:0:22842:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789446224.232667:0:22842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x62554ff37455063f 00000020:00000080:3.0:1789446224.234177:0:22842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789446224.242436:0:22842:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x62554ff374550646 00000020:00000080:1.0:1789446224.243800:0:22842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789446224.243813:0:22842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789446224.243823:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446224.243825:0:22842:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789446224.243829:0:22842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789446224.243831:0:22842:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1789446224.243833:0:22842:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789446224.243835:0:22842:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789446224.243837:0:22842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789446224.243840:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446224.243842:0:22842:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789446224.243844:0:22842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789446224.243849:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446224.243851:0:22842:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789446224.243856:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789446224.243902:0:22842:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789446224.243918:0:22842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789446224.243929:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446224.243930:0:22842:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789446224.243934:0:22842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789446224.243937:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446224.243938:0:22842:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1789446224.243941:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789446224.243946:0:22842:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:00000080:1.0:1789446224.244009:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789446224.244026:0:22842:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9c2c069e3380) 00000020:00000080:1.0:1789446224.244042:0:22842:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789446224.244047:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789446224.244105:0:22842:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1789446224.244111:0:22842:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789446224.244119:0:22842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x62554ff374550654 00010000:00080000:1.0:1789446224.244148:0:22842:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2c05b67000@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.148@tcp at head 00010000:00010000:1.0:1789446224.247461:0:22842:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1789446224.249086:0:22842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789446224.249101:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789446224.249135:0:22842:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789446224.249156:0:22842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x62554ff37455065b 00000100:00080000:3.0:1789446224.249166:0:22842:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789446224.249177:0:22842:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c2c05b67000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789446224.249213:0:22842:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2c07a93b80 x1876369794628096/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789446224.249243:0:22842:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1789446224.249318:0:22842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789446224.249322:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789446224.249324:0:22842:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1789446224.249327:0:22842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789446224.249330:0:22842:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1789446224.249332:0:22842:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789446224.249333:0:22842:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789446224.249334:0:22842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789446224.249337:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789446224.249338:0:22842:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789446224.249341:0:22842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789446224.249345:0:22842:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789446224.249349:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789446224.249351:0:22842:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789446224.249353:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789446224.249367:0:22842:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:01000000:3.0:1789446224.249389:0:22842:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789446224.249392:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789446224.249415:0:22842:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c2d3d0919c0) 00000020:00000080:3.0:1789446224.249428:0:22842:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789446224.249432:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789446224.249497:0:22842:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789446224.249503:0:22842:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789446224.249509:0:22842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x62554ff374550669 00010000:00080000:3.0:1789446224.249536:0:22842:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2c05b60800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.148@tcp at head 00010000:00010000:3.0:1789446224.249922:0:22842:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1789446224.250259:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794628096:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789446224.250336:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446224.250714:0:22829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794628096 00000100:00100000:3.0:1789446224.250722:0:22829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794628096 00000100:00100000:3.0:1789446224.250761:0:22829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789446224.250769:0:22829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3656:x1876369794628096:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1789446224.250786:0:22829:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789446224.264102:0:22829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3656:x1876369794628096:12345-0@lo:38:llog_process_th.0 Request processed in 13323us (13757us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789446224.264117:0:22829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789446224.264226:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2c05b67000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789446224.264232:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789446224.264237:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794628096:0@lo:38:llog_process_th.0 00000040:01000000:1.0:1789446224.268270:0:22842:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789446224.268555:0:22842:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789446224.271097:0:22842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789446224.271511:0:22842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1789446224.275767:0:22842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1789446224.276245:0:22848:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789446224.276250:0:22848:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789446224.277279:0:22842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789446224.277294:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789446224.277336:0:22842:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789446224.277355:0:22842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x62554ff374550670 00000100:00080000:1.0:1789446224.277376:0:22842:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789446224.277387:0:22842:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c2c05b60800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1789446224.277433:0:22842:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2c082d1180 x1876369794628224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789446224.277478:0:22842:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789446224.277548:0:22842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789446224.277553:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446224.277555:0:22842:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789446224.277558:0:22842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789446224.277561:0:22842:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1789446224.277562:0:22842:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789446224.277564:0:22842:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000100:00100000:0.0:1789446224.277791:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794628224:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789446224.277844:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876369794628224 offset 0 length 520: 4 00000020:01000000:1.0:1789446224.277943:0:22842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789446224.277948:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446224.277949:0:22842:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789446224.277953:0:22842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789446224.278018:0:22842:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789446224.278022:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446224.278024:0:22842:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789446224.278027:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789446224.278031:0:22842:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:01000000:1.0:1789446224.278052:0:22842:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789446224.278055:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789446224.278066:0:22842:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c2c069e4d40) 00000020:00000080:1.0:1789446224.278079:0:22842:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1789446224.278084:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789446224.278144:0:22842:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789446224.278149:0:22842:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1789446224.278155:0:22842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x62554ff37455067e 00010000:00080000:1.0:1789446224.278179:0:22842:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2d187ae000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.148@tcp at head 00010000:00010000:1.0:1789446224.278391:0:22842:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1789446224.278710:0:22842:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789446224.278725:0:22842:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789446224.281504:0:22842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789446224.281793:0:22842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1789446224.281947:0:22842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1789446224.282418:0:22850:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789446224.282423:0:22850:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789446224.283297:0:22842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789446224.283317:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789446224.283366:0:22842:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789446224.283387:0:22842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x62554ff374550685 00000100:00080000:0.0:1789446224.283472:0:22842:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789446224.283487:0:22842:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c2d187ae000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789446224.283526:0:22842:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2d2fa3f800 x1876369794628352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789446224.283620:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794628352:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789446224.283689:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876369794628352 offset 0 length 520: 4 00000100:00080000:0.0:1789446224.283801:0:22842:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789446224.283865:0:22842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789446224.283869:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789446224.283871:0:22842:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789446224.283874:0:22842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789446224.283878:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789446224.283880:0:22842:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789446224.283883:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789446224.283885:0:22842:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789446224.283887:0:22842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789446224.283890:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789446224.283891:0:22842:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789446224.283893:0:22842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789446224.283895:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789446224.283896:0:22842:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789446224.283899:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789446224.283926:0:22842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:282408b2-7484-4ad3-93ba-27093493daa8:22842:1876369794628480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789446224.284004:0:22842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446224.284059:0:22842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d18292e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789446224.284239:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794628480 00000100:00100000:3.0:1789446224.284246:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794628480 00000100:00100000:3.0:1789446224.284293:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789446224.284303:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+9:22842:x1876369794628480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789446224.284441:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+9:22842:x1876369794628480:12345-0@lo:502:llog_process_th.0 Request processed in 139us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446224.284448:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789446224.284756:0:22842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:282408b2-7484-4ad3-93ba-27093493daa8:22842:1876369794628480:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789446224.284785:0:22842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789446224.284790:0:22842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789446224.284792:0:22842:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789446224.284801:0:22842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1789446224.284992:0:22803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1789446224.285013:0:22803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789446224.285030:0:22803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7800/0x62554ff3745505f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550600 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446224.285040:0:22803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7800/0x62554ff3745505f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550600 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789446224.285048:0:22803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c2d41bbc000 from 1 10000000:01000000:2.0:1789446224.285051:0:22803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789446224.285077:0:22803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6800/0x62554ff37455068c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446224.285085:0:22803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6800/0x62554ff37455068c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446224.285094:0:22803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6800/0x62554ff37455068c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446224.285109:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794628608:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789446224.285149:0:22803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446224.285174:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d207c4300 going to sleep for 11 seconds 00000100:00100000:3.0:1789446224.285231:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794628608 00000100:00100000:3.0:1789446224.285236:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794628608 00000100:00100000:3.0:1789446224.285269:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789446224.285277:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+9:22803:x1876369794628608:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789446224.285286:0:22819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446224.285300:0:22819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d42054600/0x62554ff374550693 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff37455068c expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.285331:0:22819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d42054600/0x62554ff374550693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff37455068c expref: 10 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.285340:0:22819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d42054600/0x62554ff374550693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff37455068c expref: 10 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.285349:0:22819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d42054600, rc 0) 00000100:00100000:3.0:1789446224.285391:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+10:22803:x1876369794628608:12345-0@lo:101:mount.lustre.0 Request processed in 115us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446224.285397:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789446224.285476:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794628608:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789446224.285489:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6800/0x62554ff37455068c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550693 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446224.285497:0:22803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6800/0x62554ff37455068c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff374550693 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446224.286188:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794628736:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789446224.286231:0:22803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446224.286257:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d207c4300 going to sleep for 11 seconds 00000100:00100000:2.0:1789446224.286277:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794628736 00000100:00100000:2.0:1789446224.286282:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794628736 00000100:00100000:2.0:1789446224.286311:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789446224.286317:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+10:22803:x1876369794628736:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789446224.286331:0:22818:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789446224.286337:0:22818:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789446224.286416:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+10:22803:x1876369794628736:12345-0@lo:256:mount.lustre.0 Request processed in 98us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446224.286423:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789446224.286457:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794628736:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789446224.287658:0:22803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789446224.287681:0:22803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6800/0x62554ff37455068c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550693 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446224.287694:0:22803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6800/0x62554ff37455068c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550693 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789446224.288270:0:22803:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c2d41bbc000 from 1 10000000:01000000:2.0:1789446224.288273:0:22803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789446224.288311:0:22803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7600/0x62554ff37455069a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446224.288319:0:22803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7600/0x62554ff37455069a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446224.288330:0:22803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7600/0x62554ff37455069a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446224.288351:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794628864:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789446224.288432:0:22803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446224.288476:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d207c4300 going to sleep for 11 seconds 00000100:00100000:3.0:1789446224.288715:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794628864 00000100:00100000:3.0:1789446224.288722:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794628864 00000100:00100000:3.0:1789446224.288775:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789446224.288783:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+10:22803:x1876369794628864:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789446224.288796:0:22818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446224.288810:0:22818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d42054000/0x62554ff3745506a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff37455069a expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.288832:0:22818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d42054000/0x62554ff3745506a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff37455069a expref: 11 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.288844:0:22818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d42054000/0x62554ff3745506a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff37455069a expref: 11 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.288852:0:22818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d42054000, rc 0) 00000100:00100000:3.0:1789446224.288893:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+11:22803:x1876369794628864:12345-0@lo:101:mount.lustre.0 Request processed in 111us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446224.288899:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789446224.289118:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794628864:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789446224.289134:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7600/0x62554ff37455069a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745506a1 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446224.289143:0:22803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7600/0x62554ff37455069a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff3745506a1 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446224.289205:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794628992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789446224.289232:0:22803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446224.289263:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d207c4300 going to sleep for 11 seconds 00000100:00100000:3.0:1789446224.289405:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794628992 00000100:00100000:3.0:1789446224.289410:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794628992 00000100:00100000:3.0:1789446224.289442:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789446224.289449:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+11:22803:x1876369794628992:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789446224.290034:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+11:22803:x1876369794628992:12345-0@lo:501:mount.lustre.0 Request processed in 582us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446224.290041:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789446224.290210:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794628992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789446224.290244:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794629120:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789446224.290294:0:22803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446224.290324:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d207c4300 going to sleep for 11 seconds 00000100:00100000:3.0:1789446224.290533:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794629120 00000100:00100000:3.0:1789446224.290539:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794629120 00000100:00100000:3.0:1789446224.290582:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789446224.290703:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+11:22803:x1876369794629120:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789446224.290795:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+11:22803:x1876369794629120:12345-0@lo:503:mount.lustre.0 Request processed in 95us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446224.290803:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789446224.290889:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794629120:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789446224.292093:0:22852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:282408b2-7484-4ad3-93ba-27093493daa8:22852:1876369794629248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789446224.292155:0:22852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446224.292196:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d207c4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789446224.292295:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794629248 00000100:00100000:3.0:1789446224.292303:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794629248 00000100:00100000:3.0:1789446224.292347:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789446224.292366:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+11:22852:x1876369794629248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789446224.292875:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+11:22852:x1876369794629248:12345-0@lo:502:llog_process_th.0 Request processed in 520us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446224.292883:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789446224.292996:0:22852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:282408b2-7484-4ad3-93ba-27093493daa8:22852:1876369794629248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789446224.293024:0:22852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789446224.293034:0:22852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446224.293036:0:22852:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789446224.293043:0:22852:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c2d41bbc000 00000020:00000080:1.0:1789446224.293046:0:22852:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789446224.293054:0:22852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789446224.293056:0:22852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446224.293058:0:22852:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789446224.293060:0:22852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789446224.293062:0:22852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446224.293064:0:22852:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789446224.293068:0:22852:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c2d41bbc000 00000020:00000080:1.0:1789446224.293070:0:22852:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789446224.293128:0:22852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789446224.293132:0:22852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446224.293133:0:22852:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789446224.293136:0:22852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789446224.293139:0:22852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446224.293140:0:22852:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789446224.293143:0:22852:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c2d41bbc000 00000020:00000080:1.0:1789446224.293146:0:22852:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789446224.293164:0:22852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789446224.293167:0:22852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446224.293168:0:22852:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789446224.293170:0:22852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789446224.293172:0:22852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446224.293173:0:22852:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789446224.293176:0:22852:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c2d41bbc000 00000020:00000080:1.0:1789446224.293178:0:22852:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789446224.293224:0:22852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:282408b2-7484-4ad3-93ba-27093493daa8:22852:1876369794629376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789446224.293262:0:22852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446224.293288:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794629376 00000100:00100000:1.0:1789446224.293293:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794629376 00000100:00100000:1.0:1789446224.293317:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789446224.293324:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+11:22852:x1876369794629376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789446224.293418:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+11:22852:x1876369794629376:12345-0@lo:502:llog_process_th.0 Request processed in 93us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446224.293424:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789446224.293459:0:22852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c0188d240 going to sleep for 11 seconds 00000100:00100000:1.0:1789446224.293470:0:22852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:282408b2-7484-4ad3-93ba-27093493daa8:22852:1876369794629376:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789446224.293489:0:22852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789446224.293493:0:22852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446224.293494:0:22852:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789446224.293498:0:22852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789446224.295132:0:22803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789446224.295164:0:22803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789446224.295188:0:22803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7600/0x62554ff37455069a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745506a1 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446224.295199:0:22803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7600/0x62554ff37455069a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745506a1 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789446224.295249:0:22803:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789446224.295252:0:22803:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c2d41bbc000 10000000:01000000:2.0:1789446224.295255:0:22803:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c2d41bbc000 10000000:01000000:2.0:1789446224.295259:0:22803:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789446224.295263:0:22803:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c2d41bbc000 from 1 10000000:01000000:2.0:1789446224.295266:0:22803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789446224.295295:0:22803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6c00/0x62554ff3745506a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446224.295303:0:22803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6c00/0x62554ff3745506a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446224.295314:0:22803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6c00/0x62554ff3745506a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446224.295345:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794629504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789446224.295522:0:22803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446224.295563:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d207c46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789446224.295736:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794629504 00000100:00100000:1.0:1789446224.295744:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794629504 00000100:00100000:1.0:1789446224.295787:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789446224.295796:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+11:22803:x1876369794629504:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789446224.295809:0:22819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446224.295821:0:22819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d00030e00/0x62554ff3745506af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff3745506a8 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446224.295842:0:22819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d00030e00/0x62554ff3745506af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff3745506a8 expref: 12 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446224.295859:0:22819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d00030e00/0x62554ff3745506af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff3745506a8 expref: 12 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446224.295885:0:22819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d00030e00, rc 0) 00000100:00100000:1.0:1789446224.295936:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+12:22803:x1876369794629504:12345-0@lo:101:mount.lustre.0 Request processed in 141us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446224.295942:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789446224.296067:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794629504:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789446224.296082:0:22803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6c00/0x62554ff3745506a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745506af expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446224.296091:0:22803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6c00/0x62554ff3745506a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff3745506af expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446224.296152:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794629632:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789446224.296187:0:22803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446224.296244:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d18292e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789446224.296287:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794629632 00000100:00100000:1.0:1789446224.296291:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794629632 00000100:00100000:1.0:1789446224.296322:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789446224.296330:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+12:22803:x1876369794629632:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789446224.296719:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794629632:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789446224.296748:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794629760:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789446224.296795:0:22803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446224.296821:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d18292e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789446224.296834:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794629760 00000100:00100000:0.0:1789446224.296838:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794629760 00000100:00100000:0.0:1789446224.296859:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789446224.296866:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+13:22803:x1876369794629760:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789446224.296975:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+13:22803:x1876369794629760:12345-0@lo:503:mount.lustre.0 Request processed in 89us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446224.296983:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789446224.297023:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794629760:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789446224.297202:0:22853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:282408b2-7484-4ad3-93ba-27093493daa8:22853:1876369794629888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789446224.297236:0:22853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446224.297268:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794629888 00000100:00100000:0.0:1789446224.297272:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794629888 00000100:00100000:0.0:1789446224.297294:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789446224.297300:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+13:22853:x1876369794629888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789446224.297392:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+13:22853:x1876369794629888:12345-0@lo:502:llog_process_th.0 Request processed in 91us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446224.297674:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+13:22803:x1876369794629632:12345-0@lo:501:mount.lustre.0 Request processed in 238us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446224.297682:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789446224.299695:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789446224.299779:0:22853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d18292cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789446224.299808:0:22853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:282408b2-7484-4ad3-93ba-27093493daa8:22853:1876369794629888:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1789446224.299878:0:22853:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789446224.299896:0:22853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c2d35f48000) 00000020:00000080:0.0:1789446224.299915:0:22853:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1789446224.300042:0:22853:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2d41bbc000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789446224.300045:0:22853:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2d41bbc000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789446224.300048:0:22853:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c2d41bbc000 4 00010000:00080000:0.0:1789446224.300077:0:22853:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2d3fe93000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.148@tcp at head 00010000:00010000:0.0:1789446224.312035:0:22853:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1789446224.312237:0:22853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789446224.312280:0:22853:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789446224.312294:0:22853:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x62554ff3745506bd 00000100:00080000:0.0:1789446224.312305:0:22853:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789446224.312318:0:22853:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c2d3fe93000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789446224.312368:0:22853:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2d2fa3dc00 x1876369794630016/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789446224.312420:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1876369794630016:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789446224.312485:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446224.312583:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794630016 00000100:00100000:0.0:1789446224.312596:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794630016 00000100:00100000:0.0:1789446224.312634:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789446224.312641:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2fa3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1876369794630016:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789446224.312700:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2fa3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1876369794630016:12345-0@lo:38:llog_process_th.0 Request processed in 58us (214us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789446224.312706:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789446224.312736:0:3656:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789446224.312742:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d3fe93000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789446224.312762:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789446224.312766:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1876369794630016:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789446224.312783:0:22853:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789446224.312938:0:22853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:282408b2-7484-4ad3-93ba-27093493daa8:22853:1876369794630144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789446224.313010:0:22853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446224.313038:0:22853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d18292d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789446224.316801:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794630144 00000100:00100000:1.0:1789446224.316814:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794630144 00000100:00100000:1.0:1789446224.316875:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789446224.316886:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+12:22853:x1876369794630144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789446224.317065:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+12:22853:x1876369794630144:12345-0@lo:502:llog_process_th.0 Request processed in 181us (4053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446224.317073:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789446224.317545:0:22853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:282408b2-7484-4ad3-93ba-27093493daa8:22853:1876369794630144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789446224.318720:0:22853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:282408b2-7484-4ad3-93ba-27093493daa8:22853:1876369794630272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789446224.318784:0:22853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446224.318854:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794630272 00000100:00100000:0.0:1789446224.318860:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794630272 00000100:00100000:0.0:1789446224.318903:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789446224.318911:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+12:22853:x1876369794630272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789446224.319073:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+12:22853:x1876369794630272:12345-0@lo:502:llog_process_th.0 Request processed in 161us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446224.319081:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789446224.319129:0:22853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d18292d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789446224.319151:0:22853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:282408b2-7484-4ad3-93ba-27093493daa8:22853:1876369794630272:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789446224.319171:0:22853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789446224.319237:0:22803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789446224.319254:0:22803:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789446224.319268:0:22803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6c00/0x62554ff3745506a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745506af expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446224.319280:0:22803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6c00/0x62554ff3745506a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745506af expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789446224.319328:0:22803:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789446224.319330:0:22803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789446224.319331:0:22803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789446224.319333:0:22803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789446224.319334:0:22803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789446224.319335:0:22803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789446224.319337:0:22803:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789446224.319338:0:22803:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789446224.319340:0:22803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789446224.319342:0:22803:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789446224.319345:0:22803:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789446224.319348:0:22803:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789446224.319349:0:22803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789446224.319351:0:22803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789446224.319352:0:22803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789446224.319353:0:22803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789446224.319354:0:22803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789446224.319355:0:22803:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789446224.319369:0:22803:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789446224.319370:0:22803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789446224.319371:0:22803:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789446224.319386:0:22803:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789446224.321681:0:22803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794630400:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789446224.321761:0:22803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446224.321835:0:22803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d18292d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789446224.321865:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794630400 00000100:00100000:0.0:1789446224.321873:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794630400 00000100:00100000:0.0:1789446224.321915:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789446224.321923:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+12:22803:x1876369794630400:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789446224.321970:0:22819:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789446224.321983:0:22819:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789446224.328369:0:22819:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789446224.328391:0:22819:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789446224.328844:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+12:22803:x1876369794630400:12345-0@lo:253:mount.lustre.0 Request processed in 6916us (7079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446224.328855:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789446224.328922:0:22803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:22803:1876369794630400:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789446224.328935:0:22803:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789446224.328939:0:22803:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789446224.328940:0:22803:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789446224.328942:0:22803:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789446224.328943:0:22803:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789446224.328945:0:22803:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789446224.328946:0:22803:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789446224.328947:0:22803:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789446224.328949:0:22803:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789446224.328950:0:22803:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789446224.328952:0:22803:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789446224.328990:0:22803:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1789446224.329788:0:22840:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789446224.329795:0:22840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789446224.329815:0:22840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2d42055a00/0x62554ff3745506c4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.329831:0:22840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2d42054600/0x62554ff374550693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff37455068c expref: 11 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.329850:0:22840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c2d42055a00/0x62554ff3745506c4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.329890:0:22840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2d42054600/0x62554ff374550693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x62554ff37455068c expref: 11 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.329903:0:22840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2d42054600/0x62554ff374550693 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x62554ff37455068c expref: 11 pid: 22819 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446224.329917:0:22840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a91880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22840:1876369794630528:0@lo:104: 00000100:00100000:3.0:1789446224.329990:0:22840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446224.330025:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d089ed540 going to sleep for 11 seconds 00000100:00100000:3.0:1789446224.330068:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794630528 00000100:00100000:3.0:1789446224.330074:0:22807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794630528 00000100:00100000:3.0:1789446224.330111:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789446224.330120:0:22807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:282408b2-7484-4ad3-93ba-27093493daa8+3:22840:x1876369794630528:12345-0@lo:104: 00010000:00010000:3.0:1789446224.330133:0:22807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6800/0x62554ff37455068c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff374550693 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.330178:0:22807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789446224.330184:0:22807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:282408b2-7484-4ad3-93ba-27093493daa8+3:22840:x1876369794630528:12345-0@lo:104: Request processed in 66us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446224.330191:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789446224.330222:0:22840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a91880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22840:1876369794630528:0@lo:104: 00010000:00010000:3.0:1789446224.330237:0:22840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c2d42055a00/0x62554ff3745506c4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.330252:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789446224.330265:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6800/0x62554ff37455068c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff374550693 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.330271:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d35ea6800 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:3.0:1789446224.330275:0:22813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6800/0x62554ff37455068c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x62554ff374550693 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.330283:0:22813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6800/0x62554ff37455068c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x62554ff374550693 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789446224.330290:0:22813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6800/0x62554ff37455068c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x62554ff374550693 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789446224.330296:0:22813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789446224.330319:0:22813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6800/0x62554ff37455068c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff374550693 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.331802:0:22813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789446224.331841:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6800/0x62554ff37455068c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff374550693 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.331851:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6800/0x62554ff37455068c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff374550693 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.331873:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446224.331876:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446224.331878:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789446224.331943:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789446224.331979:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:282408b2-7484-4ad3-93ba-27093493daa8:3660:1876369794630656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789446224.332028:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446224.332078:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794630656 00000100:00100000:3.0:1789446224.332091:0:22809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794630656 00010000:00010000:3.0:1789446224.332120:0:22809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2d42054600/0x62554ff374550693 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff37455068c expref: 12 pid: 22819 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446224.332146:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789446224.332153:0:22809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:282408b2-7484-4ad3-93ba-27093493daa8+12:3660:x1876369794630656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789446224.332164:0:22809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789446224.332169:0:22809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2d42054600/0x62554ff374550693 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff37455068c expref: 12 pid: 22819 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.332181:0:22809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2d42054600/0x62554ff374550693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x62554ff37455068c expref: 12 pid: 22819 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.332195:0:22809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d42054600/0x62554ff374550693 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x62554ff37455068c expref: 12 pid: 22819 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.332210:0:22809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c2d42055a00/0x62554ff3745506c4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.332218:0:22809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d42055a00/0x62554ff3745506c4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789446224.332232:0:22809:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002437502s 00010000:00010000:3.0:1789446224.332236:0:22809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2d42055a00/0x62554ff3745506c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.332243:0:22809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2d42055a00/0x62554ff3745506c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.332250:0:22809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2d42055a00/0x62554ff3745506c4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.332267:0:22809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2d42055a00/0x62554ff3745506c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.332273:0:22809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d42055a00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446224.332277:0:22809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2d42055a00/0x62554ff3745506c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.332286:0:22809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2d42055a00/0x62554ff3745506c4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.332301:0:22809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2d42055a00/0x62554ff3745506c4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.332310:0:22809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789446224.332343:0:22809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:282408b2-7484-4ad3-93ba-27093493daa8+11:3660:x1876369794630656:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446224.332350:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789446224.332389:0:22840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c2d42055a00/0x62554ff3745506c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.334780:0:22840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2d42055a00/0x62554ff3745506c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446224.334801:0:22840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d42055a00/0x62554ff3745506c4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446224.334864:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:282408b2-7484-4ad3-93ba-27093493daa8:3660:1876369794630656:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789446224.371781:0:22803:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:0.0:1789446224.372079:0:22803:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789446224.372204:0:22864:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:1.0:1789446224.372208:0:22864:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:1.0:1789446224.372311:0:22865:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1789446224.372710:0:22865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789446224.374582:0:22803:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:2.0:1789446224.375651:0:22866:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9c2d41b7ca80 x1876369794630784/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446224.375665:0:22866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067ef900 going to sleep for 0 seconds 00000040:01000000:0.0:1789446224.376125:0:22803:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789446224.376163:0:22803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789446224.377175:0:22865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789446224.377244:0:22865:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:0.0:1789446224.379558:0:22803:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789446224.379669:0:22803:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789446224.379751:0:22803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789446224.384660:0:22803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789446224.387707:0:22803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789446224.387774:0:22803:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789446224.389524:0:22803:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1789446224.390118:0:22803:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:0.0:1789446224.393063:0:22803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1789446224.394592:0:22803:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789446224.394624:0:22803:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae1080dab988 00100000:10000000:0.0:1789446224.394631:0:22803:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789446224.395249:0:22803:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789446224.395264:0:22803:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789446224.395292:0:22803:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789446224.395316:0:22803:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1789446224.399941:0:22803:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789446224.400181:0:22803:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789446225.062181:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789446225.138081:0:22821:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789446225.138089:0:22821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c2d41bbc000 from 11 10000000:01000000:2.0:1789446225.138094:0:22821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789446225.138194:0:22821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6000/0x62554ff3745506cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446225.138206:0:22821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6000/0x62554ff3745506cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446225.138217:0:22821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6000/0x62554ff3745506cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446225.138242:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794630912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789446225.138344:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446225.138405:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d187eacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789446225.138425:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794630912 00000100:00100000:2.0:1789446225.138431:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794630912 00000100:00100000:2.0:1789446225.138474:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789446225.138482:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+11:22821:x1876369794630912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789446225.138494:0:22818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789446225.138507:0:22818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d35ea6e00/0x62554ff3745506d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff3745506cb expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446225.138536:0:22818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d35ea6e00/0x62554ff3745506d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff3745506cb expref: 12 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446225.138546:0:22818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d35ea6e00/0x62554ff3745506d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff3745506cb expref: 12 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446225.138555:0:22818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d35ea6e00, rc 0) 00000100:00100000:2.0:1789446225.139333:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+12:22821:x1876369794630912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 848us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446225.139341:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789446225.139481:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794630912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789446225.139499:0:22821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6000/0x62554ff3745506cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745506d2 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446225.139510:0:22821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6000/0x62554ff3745506cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff3745506d2 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446225.139564:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794631040:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789446225.139600:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446225.139654:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c06514180 going to sleep for 11 seconds 00000100:00100000:0.0:1789446225.139669:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794631040 00000100:00100000:0.0:1789446225.139674:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794631040 00000100:00100000:0.0:1789446225.139701:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789446225.139707:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+12:22821:x1876369794631040:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789446225.139723:0:22819:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789446225.139736:0:22819:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789446225.139740:0:22819:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1789446225.139838:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+12:22821:x1876369794631040:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446225.139851:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789446225.139886:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794631040:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789446225.139924:0:22821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789446225.139930:0:22821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6000/0x62554ff3745506cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745506d2 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446225.139939:0:22821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6000/0x62554ff3745506cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745506d2 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446225.382047:0:22866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067ef900 going to sleep for 0 seconds 00000040:00080000:1.0:1789446225.383432:0:22862:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789446225.383440:0:22862:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789446225.392809:0:22862:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789446225.392836:0:22862:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1789446226.086827:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446226.406657:0:22866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067ef900 going to sleep for 0 seconds 00000040:00080000:1.0:1789446226.407126:0:22862:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789446226.407131:0:22862:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789446226.407232:0:22862:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1789446226.407273:0:22862:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789446226.407675:0:22862:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:3.0:1789446227.119402:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446227.430944:0:22866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067ef900 going to sleep for 0 seconds 00010000:00010000:3.0:1789446228.136268:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446228.455345:0:22866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067ef900 going to sleep for 0 seconds 00000001:02000400:1.0:1789446228.998261:0:23109:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789446229.162138:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446229.478713:0:22866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067ef900 going to sleep for 0 seconds 00000100:00080000:3.0:1789446229.734224:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789446229.734231:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789446229.734234:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c2c05b67000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789446229.734242:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 606 00000100:00080000:3.0:1789446229.734248:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789446229.734259:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c2c05b67000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789446229.734282:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2c07a90000 x1876369794631296/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789446229.734308:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789446229.734311:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789446229.734314:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789446229.734317:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789446229.734320:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789446229.734324:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789446229.734325:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c2d3fe93000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789446229.734341:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c2d3fe93000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789446229.734353:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2c07a90e00 x1876369794631424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789446229.734403:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789446229.734417:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:282408b2-7484-4ad3-93ba-27093493daa8:3659:1876369794631168:0@lo:400:kworker.0 00000100:00100000:2.0:1789446229.734480:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446229.734688:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794631168 00000100:00100000:3.0:1789446229.734695:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794631168 00000100:00100000:3.0:1789446229.734744:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789446229.734753:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+12:3659:x1876369794631168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446229.734829:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+12:3659:x1876369794631168:12345-0@lo:400:kworker.0 Request processed in 77us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446229.734837:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789446229.735042:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:282408b2-7484-4ad3-93ba-27093493daa8:3659:1876369794631168:0@lo:400:kworker.0 00000100:00100000:1.0:1789446229.735152:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794631296:0@lo:38:kworker.0 00000100:00100000:1.0:1789446229.735186:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446229.735216:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1876369794631424:0@lo:38:kworker.0 00000100:00100000:1.0:1789446229.735243:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446229.735324:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794631424 00000100:00100000:2.0:1789446229.735329:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794631424 00000100:00100000:2.0:1789446229.735368:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789446229.735373:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1876369794631424:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789446229.735394:0:22826:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 611 last 0 00000020:00000080:2.0:1789446229.735425:0:22826:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x62554ff3745506d9 00000004:00100000:2.0:1789446229.735439:0:22826:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789446229.735587:0:22826:0:(import.c:65:import_set_state_nolock()) ffff9c2c08267800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789446229.735637:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1876369794631424:12345-0@lo:38:kworker.0 Request processed in 262us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446229.735644:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789446229.735872:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c2c07a90e00 x1876369794631424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789446239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789446229.735887:0:3656:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789446229.735894:0:3656:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789446229.735898:0:3656:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789446229.735900:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d3fe93000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789446229.735906:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1876369794631424:0@lo:38:kworker.0 00000100:00100000:3.0:1789446229.736988:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794631296 00000100:00100000:3.0:1789446229.736999:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794631296 00000100:00100000:3.0:1789446229.737033:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789446229.737039:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3656:x1876369794631296:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789446229.737055:0:22830:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789446229.737121:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3656:x1876369794631296:12345-0@lo:38:kworker.0 Request processed in 81us (1934us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789446229.737127:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789446229.737294:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2c05b67000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789446229.737300:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789446229.737303:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794631296:0@lo:38:kworker.0 00000020:00000004:1.0:1789446230.002285:0:23161:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789446230.002493:0:23161:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789446230.183286:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789446230.502368:0:22866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067ef900 going to sleep for 0 seconds 00000020:00000004:3.0:1789446230.981712:0:23211:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789446230.982353:0:23211:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789446231.206685:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446231.529230:0:22866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067ef900 going to sleep for 0 seconds 00010000:00010000:3.0:1789446232.232106:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446232.550081:0:22866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067ef900 going to sleep for 0 seconds 00010000:00010000:1.0:1789446233.256851:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789446233.578817:0:22866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067ef900 going to sleep for 0 seconds 00010000:00010000:3.0:1789446234.278787:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446234.598067:0:22866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067ef900 going to sleep for 0 seconds 00000100:00100000:3.0:1789446234.854048:0:3656:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789446224/real 1789446224] req@ffff9c2d2fa3f800 x1876369794628352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789446234 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789446234.854080:0:3656:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c2d2fa3f800 x1876369794628352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789446234 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789446234.854091:0:3656:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789446224/real 1789446224] req@ffff9c2c082d1180 x1876369794628224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789446234 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789446234.854103:0:3656:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c2c082d1180 x1876369794628224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789446234 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789446234.854141:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d187ae000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789446234.854150:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789446234.854154:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794628352:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789446234.854160:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2c05b60800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789446234.854165:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789446234.854167:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794628224:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789446234.854333:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789446234.854338:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789446234.854340:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c2c05b67000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789446234.854345:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 611 00000100:00080000:0.0:1789446234.854413:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789446234.854424:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c2c05b67000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789446234.854869:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2d2fa3e680 x1876369794631680/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789446234.854938:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789446234.854942:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789446234.854944:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c2c05b60800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789446234.854947:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 606 00000100:00080000:0.0:1789446234.854950:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789446234.854991:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c2c05b60800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789446234.855006:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2d2fa3c700 x1876369794631808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789446234.855017:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789446234.855020:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789446234.855021:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c2d187ae000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789446234.855024:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 606 00000100:00080000:0.0:1789446234.855027:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789446234.855032:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c2d187ae000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789446234.855042:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2d2fa3c000 x1876369794631936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789446234.855077:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794631680:0@lo:38:kworker.0 00000100:00100000:0.0:1789446234.855143:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446234.855222:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794631808:0@lo:8:kworker.0 00000400:00000100:0.0:1789446234.855242:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876369794631808 offset 0 length 520: 4 00000100:00100000:0.0:1789446234.855264:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794631936:0@lo:8:kworker.0 00000400:00000100:0.0:1789446234.855283:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876369794631936 offset 0 length 520: 4 00000100:00100000:0.0:1789446234.855329:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794631680 00000100:00100000:0.0:1789446234.855336:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794631680 00000100:00100000:0.0:1789446234.855367:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789446234.855374:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2fa3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3656:x1876369794631680:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789446234.855389:0:22830:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789446234.859904:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:282408b2-7484-4ad3-93ba-27093493daa8:3657:1876369794631552:0@lo:400:kworker.0 00000100:00100000:2.0:1789446234.859992:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446234.860044:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789446234.860052:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1876369794632064:0@lo:400:kworker.0 00000100:00100000:2.0:1789446234.860099:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446234.860141:0:22825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794632064 00000100:00100000:2.0:1789446234.860149:0:22825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794632064 00000100:00100000:2.0:1789446234.860190:0:22825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789446234.860199:0:22825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1876369794632064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446234.860248:0:22825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1876369794632064:12345-0@lo:400:kworker.0 Request processed in 50us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446234.860255:0:22825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789446234.860293:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c2d2fa3ed80 x1876369794632064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446234.860305:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1876369794632064:0@lo:400:kworker.0 00000100:00100000:2.0:1789446234.860792:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794631552 00000100:00100000:2.0:1789446234.860797:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794631552 00000100:00100000:2.0:1789446234.860833:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789446234.860840:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+12:3657:x1876369794631552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446234.860882:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+12:3657:x1876369794631552:12345-0@lo:400:kworker.0 Request processed in 42us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446234.860898:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789446234.860937:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:282408b2-7484-4ad3-93ba-27093493daa8:3657:1876369794631552:0@lo:400:kworker.0 00000100:00100000:0.0:1789446234.902019:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2fa3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3656:x1876369794631680:12345-0@lo:38:kworker.0 Request processed in 46633us (46865us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789446234.902051:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789446234.902167:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2c05b67000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789446234.902173:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789446234.902177:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794631680:0@lo:38:kworker.0 00010000:00010000:2.0:1789446235.315708:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446235.622164:0:22866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067ef900 going to sleep for 0 seconds 00010000:00010000:3.0:1789446236.332873:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446236.651758:0:22866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067ef900 going to sleep for 0 seconds 00000040:00080000:0.0:1789446236.652485:0:22862:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789446237.351585:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446237.670137:0:22866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067ef900 going to sleep for 0 seconds 00000020:01000004:0.0:1789446237.920701:0:23556:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789446237.920705:0:23556:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789446237.920706:0:23556:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789446237.920812:0:23556:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c2d3fe3e000 00000020:01000004:0.0:1789446237.920826:0:23556:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1789446237.920836:0:23556:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789446237.920848:0:23556:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9c2d35f4cd40) 00000020:00000080:0.0:1789446237.920863:0:23556:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789446237.987229:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789446237.987658:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1789446237.988755:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789446237.989010:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1789446237.989553:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789446237.989896:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1789446237.990353:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789446237.990777:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1789446237.991032:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789446237.991263:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1789446237.991669:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1789446237.991902:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789446237.992197:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1789446237.992562:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789446237.993375:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1789446237.994124:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1789446237.994342:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1789446237.994749:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1789446237.995075:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1789446237.995339:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1789446237.995756:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1789446237.995988:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1789446237.996260:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1789446237.996698:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1789446237.996930:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789446237.997272:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1789446237.997717:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1789446237.997954:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789446237.998214:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1789446237.998773:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1789446237.999024:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789446237.999262:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1789446237.999724:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1789446238.000050:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1789446238.000340:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1789446238.000735:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789446238.000983:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1789446238.001211:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789446238.001538:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1789446238.001894:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1789446238.002404:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789446238.002688:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1789446238.003138:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789446238.003624:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1789446238.003988:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1789446238.004234:0:23556:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00080000:01000000:1.0:1789446238.007418:0:23556:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789446238.007663:0:23556:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1789446238.007673:0:23556:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789446238.007692:0:23556:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x62554ff3745506e7 00000020:01000004:1.0:1789446238.007699:0:23556:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789446238.007718:0:23556:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.148@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789446238.007722:0:23556:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789446238.007728:0:23556:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1789446238.007755:0:23556:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1789446238.007759:0:23556:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1789446238.016841:0:23556:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789446238.016885:0:23556:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.148@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1789446238.016889:0:23556:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789446238.016891:0:23556:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789446238.016892:0:23556:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789446238.016894:0:23556:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789446238.016895:0:23556:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789446238.016897:0:23556:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789446238.016898:0:23556:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789446238.016899:0:23556:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789446238.016901:0:23556:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789446238.016904:0:23556:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1789446238.016906:0:23556:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789446238.016908:0:23556:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789446238.016909:0:23556:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789446238.016910:0:23556:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789446238.016911:0:23556:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789446238.016912:0:23556:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789446238.016913:0:23556:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789446238.016914:0:23556:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789446238.016915:0:23556:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789446238.016938:0:23556:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789446238.016986:0:23556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794632192:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789446238.017059:0:23556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446238.017107:0:23556:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d08104e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789446238.017479:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794632192 00000100:00100000:0.0:1789446238.017486:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794632192 00000100:00100000:0.0:1789446238.017550:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789446238.017560:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+12:23556:x1876369794632192:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789446238.017589:0:22819:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789446238.017592:0:22819:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1789446238.017598:0:22819:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789446238.017919:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+12:23556:x1876369794632192:12345-0@lo:253:mount.lustre.0 Request processed in 359us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446238.017928:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789446238.018173:0:23556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794632192:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789446238.018184:0:23556:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789446238.018188:0:23556:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789446238.018190:0:23556:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789446238.018191:0:23556:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789446238.018192:0:23556:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789446238.018194:0:23556:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789446238.018195:0:23556:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789446238.018197:0:23556:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789446238.018199:0:23556:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789446238.018200:0:23556:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789446238.018215:0:23556:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c2d3fe3e000 from lustre-MDT0001 10000000:01000000:3.0:1789446238.018240:0:23556:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1789446238.018243:0:23556:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789446238.018249:0:23556:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c2c069e0000 local copy 00010000:00010000:3.0:1789446238.018258:0:23556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50400/0x62554ff3745505dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745505e4 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446238.018353:0:23556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794632320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789446238.018384:0:23556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446238.018418:0:23556:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d08104f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789446238.018494:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794632320 00000100:00100000:2.0:1789446238.018500:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794632320 00000100:00100000:2.0:1789446238.018547:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789446238.018555:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+12:23556:x1876369794632320:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789446238.018624:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+12:23556:x1876369794632320:12345-0@lo:501:mount.lustre.0 Request processed in 70us (239us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789446238.018632:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789446238.018734:0:23556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794632320:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789446238.018746:0:23556:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789446238.018762:0:23556:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789446238.018767:0:23556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50400/0x62554ff3745505dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745505e4 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.018776:0:23556:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50400/0x62554ff3745505dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745505e4 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789446238.018814:0:23556:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c2d3fe3e000 10000000:01000000:3.0:1789446238.018819:0:23556:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789446238.018824:0:23556:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c2c069e0000 10000000:01000000:3.0:1789446238.018826:0:23556:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789446238.018830:0:23556:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c2c069e0000 from 1 10000000:01000000:3.0:1789446238.018833:0:23556:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789446238.018856:0:23556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d42054600/0x62554ff3745506ee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.018864:0:23556:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d42054600/0x62554ff3745506ee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.018874:0:23556:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d42054600/0x62554ff3745506ee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446238.018887:0:23556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794632448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789446238.018912:0:23556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446238.018936:0:23556:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d08104f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789446238.019080:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794632448 00000100:00100000:2.0:1789446238.019085:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794632448 00000100:00100000:2.0:1789446238.019112:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789446238.019119:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+12:23556:x1876369794632448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789446238.019128:0:22816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789446238.019140:0:22816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d35ea7e00/0x62554ff3745506f5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff3745506ee expref: -99 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446238.019159:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d35ea7e00/0x62554ff3745506f5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff3745506ee expref: 13 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446238.019179:0:22816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d35ea7e00/0x62554ff3745506f5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff3745506ee expref: 13 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446238.019187:0:22816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d35ea7e00, rc 0) 00000100:00100000:2.0:1789446238.019273:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+13:23556:x1876369794632448:12345-0@lo:101:mount.lustre.0 Request processed in 154us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446238.019280:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789446238.019935:0:23556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794632448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789446238.019953:0:23556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d42054600/0x62554ff3745506ee lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745506f5 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446238.020311:0:23556:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d42054600/0x62554ff3745506ee lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff3745506f5 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446238.020331:0:23556:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789446238.020350:0:23556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d42054600/0x62554ff3745506ee lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745506f5 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446238.020369:0:23556:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d42054600/0x62554ff3745506ee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745506f5 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446238.020379:0:23556:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c2d3fe3e000 10000000:01000000:0.0:1789446238.020383:0:23556:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789446238.020388:0:23556:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c2d3fe3e000 from 1 10000000:01000000:0.0:1789446238.020390:0:23556:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789446238.020412:0:23556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50200/0x62554ff3745506fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446238.020419:0:23556:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50200/0x62554ff3745506fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446238.020426:0:23556:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50200/0x62554ff3745506fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446238.020443:0:23556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794632576:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789446238.020480:0:23556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446238.020619:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794632576 00000100:00100000:3.0:1789446238.020625:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794632576 00000100:00100000:3.0:1789446238.020662:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789446238.020670:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+13:23556:x1876369794632576:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789446238.020680:0:22819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446238.020690:0:22819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d42055a00/0x62554ff374550703 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff3745506fc expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.020706:0:22819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d42055a00/0x62554ff374550703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff3745506fc expref: 14 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.020728:0:22819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d42055a00/0x62554ff374550703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff3745506fc expref: 14 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.020735:0:22819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d42055a00, rc 0) 00000100:00100000:3.0:1789446238.021155:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+14:23556:x1876369794632576:12345-0@lo:101:mount.lustre.0 Request processed in 484us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446238.021162:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789446238.021246:0:23556:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c07ae8840 going to sleep for 11 seconds 00000100:00100000:0.0:1789446238.021263:0:23556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794632576:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789446238.021276:0:23556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50200/0x62554ff3745506fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550703 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446238.021284:0:23556:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50200/0x62554ff3745506fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff374550703 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446238.021308:0:23556:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789446238.021369:0:23556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50200/0x62554ff3745506fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550703 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446238.021384:0:23556:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50200/0x62554ff3745506fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550703 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446238.021391:0:23556:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789446238.021395:0:23556:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789446238.021400:0:23556:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c2d3fe3e000 10000000:01000000:0.0:1789446238.021403:0:23556:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789446238.021406:0:23556:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1789446238.021408:0:23556:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789446238.021425:0:23556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50600/0x62554ff37455070a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446238.021432:0:23556:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50600/0x62554ff37455070a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446238.021439:0:23556:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50600/0x62554ff37455070a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446238.021453:0:23556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794632704:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789446238.021479:0:23556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446238.021520:0:23556:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c07ae8840 going to sleep for 11 seconds 00000100:00100000:3.0:1789446238.021688:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794632704 00000100:00100000:3.0:1789446238.021694:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794632704 00000100:00100000:3.0:1789446238.021728:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789446238.021736:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+14:23556:x1876369794632704:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789446238.021744:0:22818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446238.021754:0:22818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d42055400/0x62554ff374550711 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff37455070a expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.021769:0:22818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d42055400/0x62554ff374550711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff37455070a expref: 15 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.021778:0:22818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d42055400/0x62554ff374550711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff37455070a expref: 15 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.021785:0:22818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d42055400, rc 0) 00000100:00100000:3.0:1789446238.021825:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+15:23556:x1876369794632704:12345-0@lo:101:mount.lustre.0 Request processed in 89us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446238.021832:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789446238.021907:0:23556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794632704:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789446238.021919:0:23556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50600/0x62554ff37455070a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550711 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446238.021927:0:23556:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50600/0x62554ff37455070a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff374550711 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789446238.024356:0:23556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:1.0:1789446238.025153:0:23556:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789446238.030280:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1789446238.030437:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:0.0:1789446238.030455:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:0.0:1789446238.030470:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:0.0:1789446238.030482:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:0.0:1789446238.030493:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:0.0:1789446238.030572:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:0.0:1789446238.030589:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:0.0:1789446238.030612:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:0.0:1789446238.030625:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:0.0:1789446238.030638:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:0.0:1789446238.030651:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:0.0:1789446238.030664:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:0.0:1789446238.030678:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:0.0:1789446238.030690:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:0.0:1789446238.030702:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:0.0:1789446238.030715:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:0.0:1789446238.030730:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:0.0:1789446238.030744:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:0.0:1789446238.030756:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:0.0:1789446238.030768:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:0.0:1789446238.030779:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:0.0:1789446238.030790:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:0.0:1789446238.030804:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:0.0:1789446238.030817:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:0.0:1789446238.030830:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:0.0:1789446238.030843:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:0.0:1789446238.030855:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:0.0:1789446238.030868:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:0.0:1789446238.030882:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:0.0:1789446238.030894:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:0.0:1789446238.030905:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:0.0:1789446238.030916:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:0.0:1789446238.030928:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:0.0:1789446238.030940:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:0.0:1789446238.030954:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:0.0:1789446238.031405:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:0.0:1789446238.031530:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:0.0:1789446238.031547:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:0.0:1789446238.031561:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:0.0:1789446238.031574:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:0.0:1789446238.031599:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:0.0:1789446238.031611:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:0.0:1789446238.031622:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:0.0:1789446238.031648:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:0.0:1789446238.031653:0:23556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:0.0:1789446238.031756:0:23556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794632832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789446238.031820:0:23556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446238.031892:0:23556:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c07ae8600 going to sleep for 11 seconds 00000100:00100000:3.0:1789446238.032109:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794632832 00000100:00100000:3.0:1789446238.032115:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794632832 00000100:00100000:3.0:1789446238.032213:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789446238.032223:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+15:23556:x1876369794632832:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789446238.032371:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+15:23556:x1876369794632832:12345-0@lo:501:mount.lustre.0 Request processed in 150us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446238.032379:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789446238.032451:0:23556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794632832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789446238.032485:0:23556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794632960:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789446238.032535:0:23556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446238.034493:0:23556:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c07ae8600 going to sleep for 11 seconds 00000100:00100000:2.0:1789446238.034918:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794632960 00000100:00100000:2.0:1789446238.034926:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794632960 00000100:00100000:2.0:1789446238.035000:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789446238.035010:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+15:23556:x1876369794632960:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789446238.036567:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+15:23556:x1876369794632960:12345-0@lo:503:mount.lustre.0 Request processed in 1554us (4026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446238.036578:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789446238.037148:0:23556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794632960:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789446238.037658:0:23556:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789446238.037748:0:23556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794633088:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789446238.037798:0:23556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446238.037885:0:23556:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d187ea240 going to sleep for 11 seconds 00000100:00100000:3.0:1789446238.038868:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794633088 00000100:00100000:3.0:1789446238.038878:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794633088 00000100:00100000:3.0:1789446238.038989:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789446238.038999:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+15:23556:x1876369794633088:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789446238.040086:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+15:23556:x1876369794633088:12345-0@lo:502:mount.lustre.0 Request processed in 1084us (2282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446238.040097:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789446238.040209:0:23556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794633088:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789446238.040457:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1789446238.040486:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1789446238.040511:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1789446238.040529:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1789446238.040543:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1789446238.040568:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1789446238.040583:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1789446238.040597:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1789446238.040611:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1789446238.040627:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1789446238.040641:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1789446238.040655:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1789446238.040669:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1789446238.040682:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1789446238.040694:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1789446238.040706:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1789446238.040720:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1789446238.040733:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1789446238.040745:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1789446238.040758:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1789446238.040773:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1789446238.040786:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1789446238.040799:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1789446238.040813:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1789446238.040826:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1789446238.040839:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1789446238.040853:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1789446238.040867:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1789446238.040881:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1789446238.040893:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1789446238.040905:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1789446238.040916:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1789446238.040926:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1789446238.040937:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1789446238.040947:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1789446238.040981:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1789446238.040999:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1789446238.041013:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1789446238.041039:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1789446238.041052:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1789446238.041065:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1789446238.041077:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1789446238.041090:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1789446238.041103:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1789446238.041138:0:23556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794633216:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789446238.041192:0:23556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446238.041698:0:23556:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d187ea240 going to sleep for 11 seconds 00000100:00100000:0.0:1789446238.041772:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794633216 00000100:00100000:0.0:1789446238.041779:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794633216 00000100:00100000:0.0:1789446238.041817:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789446238.041826:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+15:23556:x1876369794633216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789446238.041993:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+15:23556:x1876369794633216:12345-0@lo:502:mount.lustre.0 Request processed in 168us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446238.042000:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789446238.042121:0:23556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794633216:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789446238.042171:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1789446238.042180:0:23556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1789446238.042876:0:23560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789446238.042886:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789446238.042889:0:23560:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789446238.042894:0:23560:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1789446238.042896:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789446238.042910:0:23560:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9c2d2fb499c0) 00000020:00000080:2.0:1789446238.042928:0:23560:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1789446238.042932:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789446238.043041:0:23560:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789446238.043049:0:23560:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x62554ff37455071f 00000020:00000080:2.0:1789446238.043258:0:23560:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789446238.043263:0:23560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789446238.043266:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789446238.043267:0:23560:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789446238.043270:0:23560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789446238.043273:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789446238.043275:0:23560:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1789446238.043278:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789446238.043285:0:23560:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9c2d2fb4cd40) 00000020:00000080:2.0:1789446238.043313:0:23560:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1789446238.043318:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789446238.043320:0:23560:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1789446238.043322:0:23560:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1789446238.043328:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789446238.043375:0:23560:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2d3fe3e000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1789446238.043386:0:23560:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9c2d2fb48000) 00000020:00000080:2.0:1789446238.043394:0:23560:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1789446238.043444:0:23560:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789446238.043449:0:23560:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x62554ff374550734 00000020:00000080:2.0:1789446238.043545:0:23560:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1789446238.043552:0:23560:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789446238.043556:0:23560:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x62554ff37455073b 00080000:01000000:2.0:1789446238.043562:0:23560:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789446238.043565:0:23560:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x62554ff374550742 00010000:00010000:3.0:1789446238.128997:0:23560:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1789446238.129744:0:23560:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1789446238.130108:0:23560:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789446238.134335:0:23560:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1789446238.134348:0:23560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789446238.134355:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789446238.134357:0:23560:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1789446238.134360:0:23560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789446238.134366:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789446238.134367:0:23560:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1789446238.134370:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789446238.134375:0:23560:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:00000080:2.0:1789446238.134402:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789446238.134417:0:23560:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9c2d3698b380) 00000020:00000080:2.0:1789446238.134438:0:23560:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1789446238.134444:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789446238.134534:0:23560:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1789446238.134541:0:23560:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789446238.134549:0:23560:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x62554ff374550750 00010000:00080000:2.0:1789446238.134592:0:23560:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2d1030c800@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.148@tcp at head 00010000:00010000:3.0:1789446238.140215:0:23560:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1789446238.142588:0:23560:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789446238.142609:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789446238.142643:0:23560:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789446238.142665:0:23560:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x62554ff374550757 00000100:00080000:2.0:1789446238.142675:0:23560:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789446238.142686:0:23560:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c2d1030c800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1789446238.142720:0:23560:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2d41b7ce00 x1876369794633344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789446238.142749:0:23560:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789446238.142832:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794633344:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789446238.142893:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446238.142997:0:22829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794633344 00000100:00100000:0.0:1789446238.143004:0:22829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794633344 00000100:00100000:0.0:1789446238.143033:0:22829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789446238.143039:0:22829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2fa3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3656:x1876369794633344:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789446238.143061:0:22829:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 620 last 0 00000020:00000080:0.0:1789446238.143105:0:22829:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x62554ff37455075e 00000004:00100000:0.0:1789446238.143117:0:22829:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789446238.143122:0:22829:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000020:01000000:2.0:1789446238.143353:0:23560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789446238.143358:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789446238.143360:0:23560:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1789446238.143363:0:23560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789446238.143365:0:23560:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1789446238.143367:0:23560:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789446238.143368:0:23560:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789446238.143370:0:23560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789446238.143372:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789446238.143374:0:23560:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789446238.143376:0:23560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789446238.143381:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789446238.143382:0:23560:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1789446238.143386:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789446238.143416:0:23560:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789446238.143431:0:23560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789446238.143435:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789446238.143436:0:23560:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1789446238.143439:0:23560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789446238.143440:0:23560:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1789446238.143442:0:23560:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789446238.143443:0:23560:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789446238.143445:0:23560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789446238.143447:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789446238.143453:0:23560:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789446238.143457:0:23560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789446238.143460:0:23560:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789446238.143464:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789446238.143465:0:23560:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789446238.143468:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789446238.143471:0:23560:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:01000000:2.0:1789446238.143489:0:23560:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789446238.143492:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789446238.143515:0:23560:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9c2d36988000) 00000020:00000080:2.0:1789446238.143528:0:23560:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789446238.143533:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789446238.143597:0:23560:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1789446238.143604:0:23560:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789446238.143610:0:23560:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x62554ff37455076c 00010000:00080000:2.0:1789446238.143635:0:23560:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2d31d3c000@lustre-OST0000-osc-MDT0001: add connection 192.168.206.148@tcp at head 00010000:00010000:2.0:1789446238.143837:0:23560:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:3.0:1789446238.149254:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789446238.149263:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789446238.149267:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c2c05b67000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789446238.149274:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 616 00000100:00080000:3.0:1789446238.149280:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789446238.149302:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c2c05b67000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789446238.149334:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2c07a91500 x1876369794633472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789446238.149364:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789446238.149377:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789446238.149380:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789446238.149382:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789446238.149478:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794633472:0@lo:38:kworker.0 00000100:00100000:2.0:1789446238.149560:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446238.149731:0:22830:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1789446238.149740:0:22830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1789446238.150003:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794633472 00000100:00100000:3.0:1789446238.150011:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794633472 00000100:00100000:3.0:1789446238.150111:0:23565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789446238.150119:0:23565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3656:x1876369794633472:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1789446238.150179:0:23565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3656:x1876369794633472:12345-0@lo:38:kworker.0 Request processed in 58us (618us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789446238.150186:0:23565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789446238.150270:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876369794633600:0@lo:400:kworker.0 00000100:00100000:1.0:1789446238.150316:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446238.150664:0:3656:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789446238.150672:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2c05b67000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789446238.150676:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789446238.150680:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794633472:0@lo:38:kworker.0 00000100:00080000:2.0:1789446238.150887:0:22829:0:(import.c:65:import_set_state_nolock()) ffff9c2d31d3d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789446238.150936:0:22829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2fa3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3656:x1876369794633344:12345-0@lo:38:llog_process_th.0 Request processed in 7895us (8042us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446238.151010:0:22829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789446238.151044:0:3656:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789446238.151051:0:3656:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1789446238.151062:0:3656:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789446238.151068:0:3656:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789446238.151070:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d1030c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789446238.151085:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794633344:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789446238.151151:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794633600 00000100:00100000:3.0:1789446238.151156:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794633600 00000100:00100000:3.0:1789446238.151193:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789446238.151201:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876369794633600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446238.151241:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876369794633600:12345-0@lo:400:kworker.0 Request processed in 41us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446238.151247:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789446238.151396:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c2c07a93100 x1876369794633600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789446238.151408:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876369794633600:0@lo:400:kworker.0 00000100:00100000:2.0:1789446238.151481:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789446238.151490:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794633728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789446238.151674:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:0.0:1789446238.152441:0:23560:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789446238.152878:0:23560:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789446238.154310:0:23560:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789446238.154545:0:23560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1789446238.154697:0:23560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:3.0:1789446238.155363:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794633728 00000100:00100000:3.0:1789446238.155372:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794633728 00000100:00100000:3.0:1789446238.155417:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789446238.155427:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3659:x1876369794633728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789446238.155459:0:22830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789446238.155547:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3659:x1876369794633728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (3873us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446238.155554:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789446238.155667:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794633728:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789446238.157231:0:23566:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789446238.157238:0:23566:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789446238.158465:0:23560:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789446238.158477:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789446238.158582:0:23560:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789446238.158603:0:23560:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x62554ff374550773 00000100:00080000:1.0:1789446238.158613:0:23560:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789446238.158634:0:23560:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c2d31d3c000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1789446238.158667:0:23560:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2c082d0a80 x1876369794633856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789446238.158731:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794633856:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789446238.158777:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876369794633856 offset 0 length 520: 4 00000100:00080000:1.0:1789446238.158827:0:23560:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789446238.158892:0:23560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789446238.158897:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446238.158899:0:23560:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789446238.158902:0:23560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789446238.158904:0:23560:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1789446238.158906:0:23560:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789446238.158907:0:23560:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789446238.158909:0:23560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789446238.158911:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446238.158913:0:23560:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789446238.158915:0:23560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789446238.158919:0:23560:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789446238.158922:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446238.158923:0:23560:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789446238.158926:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789446238.158929:0:23560:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:01000000:1.0:1789446238.158947:0:23560:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789446238.158949:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789446238.159137:0:23560:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9c2c069e19c0) 00000020:00000080:1.0:1789446238.159152:0:23560:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1789446238.159158:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789446238.159216:0:23560:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1789446238.159222:0:23560:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789446238.159227:0:23560:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x62554ff374550781 00010000:00080000:1.0:1789446238.159251:0:23560:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2d3fea6800@lustre-OST0001-osc-MDT0001: add connection 192.168.206.148@tcp at head 00010000:00010000:1.0:1789446238.159459:0:23560:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789446238.159533:0:23560:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789446238.159554:0:23560:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1789446238.159989:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789446238.159995:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789446238.159997:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789446238.160000:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1789446238.161192:0:23560:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789446238.161474:0:23560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1789446238.161649:0:23560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:3.0:1789446238.162222:0:23568:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789446238.162227:0:23568:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789446238.162883:0:23560:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789446238.162894:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789446238.162926:0:23560:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789446238.162944:0:23560:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x62554ff374550788 00000100:00080000:1.0:1789446238.162953:0:23560:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789446238.163087:0:23560:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c2d3fea6800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1789446238.163119:0:23560:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2c082d2d80 x1876369794633984/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789446238.163180:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794633984:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789446238.163226:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876369794633984 offset 0 length 520: 4 00000100:00080000:1.0:1789446238.163276:0:23560:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789446238.163378:0:23560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789446238.163382:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446238.163384:0:23560:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789446238.163387:0:23560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789446238.163390:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446238.163392:0:23560:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789446238.163395:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789446238.163397:0:23560:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789446238.163399:0:23560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789446238.163401:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446238.163403:0:23560:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789446238.163405:0:23560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789446238.163407:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446238.163408:0:23560:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789446238.163412:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789446238.163431:0:23560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789446238.163434:0:23560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446238.163435:0:23560:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789446238.163438:0:23560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:3.0:1789446238.163591:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789446238.163596:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789446238.163598:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789446238.163601:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1789446238.163742:0:23556:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1789446238.163772:0:23556:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789446238.163830:0:23556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50600/0x62554ff37455070a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550711 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446238.163842:0:23556:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50600/0x62554ff37455070a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550711 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446238.163850:0:23556:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c2d3fe3e000 from 1 10000000:01000000:0.0:1789446238.163853:0:23556:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789446238.163880:0:23556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51a00/0x62554ff37455078f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446238.163889:0:23556:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51a00/0x62554ff37455078f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446238.163899:0:23556:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51a00/0x62554ff37455078f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446238.163916:0:23556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794634112:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789446238.163987:0:23556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446238.164043:0:23556:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c07ae8840 going to sleep for 11 seconds 00000100:00100000:3.0:1789446238.164118:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794634112 00000100:00100000:3.0:1789446238.164125:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794634112 00000100:00100000:3.0:1789446238.164177:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789446238.164186:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+15:23556:x1876369794634112:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789446238.164198:0:22819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446238.164210:0:22819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d42054c00/0x62554ff374550796 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff37455078f expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.164233:0:22819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d42054c00/0x62554ff374550796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff37455078f expref: 16 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.164244:0:22819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d42054c00/0x62554ff374550796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff37455078f expref: 16 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.164251:0:22819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d42054c00, rc 0) 00000100:00100000:3.0:1789446238.164302:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+16:23556:x1876369794634112:12345-0@lo:101:mount.lustre.0 Request processed in 108us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446238.164314:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789446238.164431:0:23556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794634112:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789446238.164446:0:23556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51a00/0x62554ff37455078f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550796 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446238.164456:0:23556:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51a00/0x62554ff37455078f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff374550796 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446238.165125:0:23556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794634240:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789446238.165164:0:23556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446238.165270:0:23556:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d1041ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789446238.167098:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794634240 00000100:00100000:3.0:1789446238.167109:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794634240 00000100:00100000:3.0:1789446238.167157:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789446238.167166:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+16:23556:x1876369794634240:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789446238.167188:0:22816:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789446238.167210:0:22816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789446238.167213:0:22816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1789446238.167727:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+16:23556:x1876369794634240:12345-0@lo:256:mount.lustre.0 Request processed in 561us (2561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446238.167736:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789446238.167829:0:23556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794634240:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789446238.168448:0:23556:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789446238.168464:0:23556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51a00/0x62554ff37455078f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550796 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446238.168475:0:23556:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51a00/0x62554ff37455078f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550796 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789446238.168484:0:23556:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c2d3fe3e000 from 1 10000000:01000000:1.0:1789446238.168487:0:23556:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789446238.168765:0:23556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d00030000/0x62554ff37455079d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446238.168775:0:23556:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d00030000/0x62554ff37455079d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446238.168785:0:23556:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d00030000/0x62554ff37455079d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446238.168819:0:23556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794634368:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789446238.168862:0:23556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446238.168936:0:23556:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d1041ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1789446238.169041:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794634368 00000100:00100000:0.0:1789446238.169048:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794634368 00000100:00100000:1.0:1789446238.169137:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789446238.169145:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+16:23556:x1876369794634368:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789446238.169156:0:22818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446238.169166:0:22818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d00031200/0x62554ff3745507a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff37455079d expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446238.169187:0:22818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d00031200/0x62554ff3745507a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff37455079d expref: 17 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446238.169198:0:22818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d00031200/0x62554ff3745507a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff37455079d expref: 17 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446238.169206:0:22818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d00031200, rc 0) 00000100:00100000:1.0:1789446238.169247:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+17:23556:x1876369794634368:12345-0@lo:101:mount.lustre.0 Request processed in 103us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446238.169254:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789446238.169336:0:23556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794634368:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789446238.169349:0:23556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d00030000/0x62554ff37455079d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745507a4 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446238.169357:0:23556:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d00030000/0x62554ff37455079d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff3745507a4 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789446238.172278:0:23556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1789446238.172683:0:23556:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789446238.172850:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1789446238.172875:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1789446238.172888:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1789446238.172902:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1789446238.172927:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1789446238.172940:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1789446238.172953:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1789446238.173087:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1789446238.173101:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1789446238.173358:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1789446238.173375:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1789446238.173396:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1789446238.173402:0:23556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1789446238.173478:0:23556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794634496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789446238.173661:0:23556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446238.173774:0:23556:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d3d099480 going to sleep for 11 seconds 00000100:00100000:1.0:1789446238.174048:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794634496 00000100:00100000:1.0:1789446238.174055:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794634496 00000100:00100000:1.0:1789446238.174139:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789446238.174149:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+17:23556:x1876369794634496:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789446238.174269:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+17:23556:x1876369794634496:12345-0@lo:501:mount.lustre.0 Request processed in 121us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446238.174276:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789446238.174370:0:23556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794634496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789446238.174403:0:23556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794634624:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789446238.174448:0:23556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446238.174549:0:23556:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d3d099480 going to sleep for 11 seconds 00000100:00100000:2.0:1789446238.176034:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794634624 00000100:00100000:2.0:1789446238.176045:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794634624 00000100:00100000:2.0:1789446238.176088:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789446238.176096:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+17:23556:x1876369794634624:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789446238.176240:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+17:23556:x1876369794634624:12345-0@lo:503:mount.lustre.0 Request processed in 144us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446238.176248:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789446238.176368:0:23556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794634624:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789446238.176954:0:23556:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789446238.177043:0:23556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794634752:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789446238.177086:0:23556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446238.177190:0:23556:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d3d099480 going to sleep for 11 seconds 00000100:00100000:1.0:1789446238.177257:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794634752 00000100:00100000:1.0:1789446238.177263:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794634752 00000100:00100000:3.0:1789446238.177335:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789446238.177345:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+17:23556:x1876369794634752:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789446238.177425:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+17:23556:x1876369794634752:12345-0@lo:502:mount.lustre.0 Request processed in 82us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446238.177432:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789446238.177517:0:23556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794634752:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789446238.177685:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1789446238.177712:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:0.0:1789446238.177726:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:0.0:1789446238.177739:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:0.0:1789446238.177752:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:0.0:1789446238.177765:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:0.0:1789446238.177793:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:0.0:1789446238.177809:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:0.0:1789446238.177821:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1789446238.177831:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:0.0:1789446238.177842:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:0.0:1789446238.177862:0:23556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794634880:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789446238.177897:0:23556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446238.178210:0:23556:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d3d099480 going to sleep for 11 seconds 00000100:00100000:2.0:1789446238.178243:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794634880 00000100:00100000:2.0:1789446238.178248:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794634880 00000100:00100000:2.0:1789446238.178272:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789446238.178279:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3eded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+17:23556:x1876369794634880:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789446238.178412:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3eded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+17:23556:x1876369794634880:12345-0@lo:502:mount.lustre.0 Request processed in 132us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446238.178426:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789446238.178684:0:23556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794634880:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789446238.178731:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:0.0:1789446238.178740:0:23556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789446238.179812:0:23570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789446238.179822:0:23570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789446238.179824:0:23570:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789446238.179832:0:23570:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c2d3fe3e000 00000020:00000080:3.0:1789446238.179834:0:23570:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789446238.179841:0:23570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789446238.179844:0:23570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789446238.179845:0:23570:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789446238.179848:0:23570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789446238.179851:0:23570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789446238.179852:0:23570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789446238.179856:0:23570:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c2d3fe3e000 00000020:00000080:3.0:1789446238.179863:0:23570:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789446238.180057:0:23570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789446238.180062:0:23570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789446238.180063:0:23570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789446238.180067:0:23570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789446238.180069:0:23570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789446238.180071:0:23570:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789446238.180074:0:23570:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c2d3fe3e000 00000020:00000080:3.0:1789446238.180076:0:23570:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789446238.191625:0:23570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789446238.191637:0:23570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789446238.191639:0:23570:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789446238.191643:0:23570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789446238.191648:0:23570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789446238.191649:0:23570:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789446238.191654:0:23570:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c2d3fe3e000 00000020:00000080:3.0:1789446238.191656:0:23570:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789446238.191711:0:23570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789446238.191714:0:23570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789446238.191716:0:23570:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789446238.191719:0:23570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:1.0:1789446238.194681:0:23556:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789446238.194727:0:23556:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789446238.195613:0:23556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d00030000/0x62554ff37455079d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745507a4 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446238.195628:0:23556:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d00030000/0x62554ff37455079d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745507a4 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789446238.195685:0:23556:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789446238.195688:0:23556:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c2d3fe3e000 10000000:01000000:1.0:1789446238.195691:0:23556:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c2d3fe3e000 10000000:01000000:1.0:1789446238.195695:0:23556:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789446238.195700:0:23556:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c2d3fe3e000 from 1 10000000:01000000:1.0:1789446238.195703:0:23556:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789446238.195737:0:23556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d00031600/0x62554ff3745507ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446238.195746:0:23556:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d00031600/0x62554ff3745507ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446238.195758:0:23556:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d00031600/0x62554ff3745507ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446238.195782:0:23556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794635008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789446238.195847:0:23556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446238.195888:0:23556:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d187ea240 going to sleep for 11 seconds 00000100:00100000:2.0:1789446238.197439:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794635008 00000100:00100000:2.0:1789446238.197452:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794635008 00000100:00100000:2.0:1789446238.197509:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789446238.197592:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+17:23556:x1876369794635008:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789446238.197609:0:22819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789446238.197626:0:22819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d35ea6600/0x62554ff3745507b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff3745507ab expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446238.197652:0:22819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d35ea6600/0x62554ff3745507b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff3745507ab expref: 18 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446238.197663:0:22819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d35ea6600/0x62554ff3745507b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff3745507ab expref: 18 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446238.197671:0:22819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d35ea6600, rc 0) 00000100:00100000:2.0:1789446238.197734:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+18:23556:x1876369794635008:12345-0@lo:101:mount.lustre.0 Request processed in 217us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446238.197740:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789446238.197796:0:23556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794635008:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789446238.197814:0:23556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d00031600/0x62554ff3745507ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745507b2 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446238.197823:0:23556:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d00031600/0x62554ff3745507ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff3745507b2 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789446238.212838:0:23556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1789446238.213214:0:23556:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789446238.215221:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1789446238.215260:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1789446238.215271:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1789446238.215282:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1789446238.215307:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1789446238.215320:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1789446238.215342:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1789446238.215352:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1789446238.215363:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1789446238.215374:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1789446238.215406:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1789446238.215421:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1789446238.215433:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1789446238.215446:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1789446238.215460:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1789446238.215473:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1789446238.215486:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1789446238.215498:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1789446238.216175:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1789446238.216191:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1789446238.216205:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1789446238.216220:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1789446238.216234:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1789446238.216251:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1789446238.216265:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1789446238.216281:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1789446238.216636:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1789446238.216656:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1789446238.216668:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1789446238.216681:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1789446238.216691:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1789446238.216710:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1789446238.216724:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1789446238.216736:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1789446238.216747:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1789446238.216761:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1789446238.216775:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1789446238.216788:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1789446238.216799:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1789446238.216812:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1789446238.216824:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1789446238.216837:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1789446238.216862:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1789446238.216889:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1789446238.216906:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1789446238.216922:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1789446238.216935:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1789446238.216949:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1789446238.219426:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1789446238.219455:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1789446238.219476:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1789446238.219483:0:23556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1789446238.219614:0:23556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794635136:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789446238.220100:0:23556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446238.220146:0:23556:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d2ea62600 going to sleep for 11 seconds 00000100:00100000:3.0:1789446238.220704:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794635136 00000100:00100000:3.0:1789446238.220713:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794635136 00000100:00100000:3.0:1789446238.220763:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789446238.220772:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+18:23556:x1876369794635136:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789446238.220919:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+18:23556:x1876369794635136:12345-0@lo:501:mount.lustre.0 Request processed in 146us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446238.220928:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789446238.220954:0:23556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794635136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789446238.221024:0:23556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794635264:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789446238.221082:0:23556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446238.221138:0:23556:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d3d099480 going to sleep for 11 seconds 00000100:00100000:3.0:1789446238.222732:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794635264 00000100:00100000:3.0:1789446238.222743:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794635264 00000100:00100000:3.0:1789446238.222796:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789446238.222807:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+18:23556:x1876369794635264:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789446238.223032:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+18:23556:x1876369794635264:12345-0@lo:503:mount.lustre.0 Request processed in 226us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446238.223039:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789446238.236394:0:23556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794635264:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789446238.239700:0:23556:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789446238.239791:0:23556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794635392:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789446238.239877:0:23556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446238.239922:0:23556:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d180850c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789446238.240363:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794635392 00000100:00100000:0.0:1789446238.240371:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794635392 00000100:00100000:0.0:1789446238.240421:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789446238.240432:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+18:23556:x1876369794635392:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789446238.240593:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+18:23556:x1876369794635392:12345-0@lo:502:mount.lustre.0 Request processed in 163us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446238.240601:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789446238.242199:0:23556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794635392:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789446238.242446:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:1.0:1789446238.242475:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:1.0:1789446238.242488:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:1.0:1789446238.242513:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:1.0:1789446238.242539:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:1.0:1789446238.242553:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:1.0:1789446238.242564:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:1.0:1789446238.242575:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:1.0:1789446238.242587:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:1.0:1789446238.242599:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:1.0:1789446238.242613:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:1.0:1789446238.242624:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:1.0:1789446238.242635:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:1.0:1789446238.242648:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:1.0:1789446238.242678:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:1.0:1789446238.242692:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:1.0:1789446238.242704:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:1.0:1789446238.242717:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:1.0:1789446238.242729:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:1.0:1789446238.242742:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:1.0:1789446238.242755:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:1.0:1789446238.242767:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:1.0:1789446238.242781:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:1.0:1789446238.242793:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:1.0:1789446238.242804:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:1.0:1789446238.242816:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:1.0:1789446238.242829:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:1.0:1789446238.242845:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:1.0:1789446238.242874:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:1.0:1789446238.242890:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:1.0:1789446238.242922:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:1.0:1789446238.242938:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:1.0:1789446238.242951:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:1.0:1789446238.242988:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:1.0:1789446238.243000:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:1.0:1789446238.243011:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:1.0:1789446238.243021:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:1.0:1789446238.243032:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:1.0:1789446238.243042:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:1.0:1789446238.243052:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:1.0:1789446238.243063:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:1.0:1789446238.243073:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:1.0:1789446238.243083:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:1.0:1789446238.243093:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:1.0:1789446238.243104:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:1.0:1789446238.243114:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:1.0:1789446238.243134:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:1.0:1789446238.243146:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:1.0:1789446238.243186:0:23556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794635520:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789446238.243245:0:23556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446238.243287:0:23556:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d207dd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789446238.243333:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794635520 00000100:00100000:2.0:1789446238.243340:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794635520 00000100:00100000:2.0:1789446238.243385:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789446238.243394:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+18:23556:x1876369794635520:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789446238.243523:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+18:23556:x1876369794635520:12345-0@lo:502:mount.lustre.0 Request processed in 129us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446238.243531:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789446238.243868:0:23556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794635520:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789446238.244053:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:1.0:1789446238.244077:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:1.0:1789446238.244102:0:23556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794635648:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789446238.244140:0:23556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446238.244474:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794635648 00000100:00100000:0.0:1789446238.244480:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794635648 00000100:00100000:0.0:1789446238.244638:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789446238.244647:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+18:23556:x1876369794635648:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789446238.244764:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+18:23556:x1876369794635648:12345-0@lo:502:mount.lustre.0 Request processed in 118us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446238.244771:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789446238.244837:0:23556:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d207dd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789446238.244853:0:23556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794635648:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789446238.244897:0:23556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1789446238.244904:0:23556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789446238.250269:0:23576:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1789446238.250284:0:23576:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9c2d3d090000) 00000020:00000080:3.0:1789446238.250323:0:23576:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1789446238.250406:0:23576:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2d3fe3e000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789446238.250412:0:23576:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2d3fe3e000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789446238.250415:0:23576:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c2d3fe3e000 3 00010000:00080000:3.0:1789446238.250445:0:23576:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2d0519f000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.148@tcp at head 00010000:00010000:3.0:1789446238.252072:0:23576:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1789446238.252251:0:23576:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1789446238.252286:0:23576:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789446238.252312:0:23576:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x62554ff3745507c0 00000100:00080000:3.0:1789446238.252322:0:23576:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789446238.252330:0:23576:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c2d0519f000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789446238.252359:0:23576:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2c07a90e00 x1876369794635776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789446238.252383:0:23576:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789446238.252409:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789446238.252413:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789446238.252416:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789446238.252419:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789446238.252860:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1876369794635776:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789446238.252925:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446238.255145:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794635776 00000100:00100000:3.0:1789446238.255157:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794635776 00000040:00080000:1.0:1789446238.255532:0:23576:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:1.0:1789446238.255628:0:23556:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789446238.255656:0:23556:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789446238.255671:0:23556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d00031600/0x62554ff3745507ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745507b2 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446238.255682:0:23556:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d00031600/0x62554ff3745507ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745507b2 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789446238.255732:0:23556:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789446238.255734:0:23556:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789446238.255735:0:23556:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789446238.255736:0:23556:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789446238.255737:0:23556:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789446238.255739:0:23556:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789446238.255740:0:23556:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789446238.255741:0:23556:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789446238.255743:0:23556:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789446238.255746:0:23556:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1789446238.255749:0:23556:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789446238.255751:0:23556:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789446238.255752:0:23556:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789446238.255753:0:23556:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789446238.255754:0:23556:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789446238.255755:0:23556:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789446238.255756:0:23556:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789446238.255757:0:23556:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789446238.255758:0:23556:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789446238.255782:0:23556:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789446238.255800:0:23556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794635904:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789446238.255864:0:23556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446238.255894:0:23556:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d207dd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789446238.255943:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789446238.255950:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1876369794635776:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789446238.255997:0:22826:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 620 last 0 00000020:00000080:3.0:1789446238.256025:0:22826:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x62554ff3745507c7 00000004:00100000:3.0:1789446238.256037:0:22826:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789446238.256064:0:22826:0:(import.c:65:import_set_state_nolock()) ffff9c2d112f8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789446238.256116:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1876369794635776:12345-0@lo:38:llog_process_th.0 Request processed in 166us (3190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446238.256132:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789446238.256217:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c2c07a90e00 x1876369794635776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789446248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789446238.256227:0:3656:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789446238.256234:0:3656:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1789446238.256240:0:3656:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789446238.256244:0:3656:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789446238.256246:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d0519f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789446238.256251:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1876369794635776:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789446238.256995:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794635904 00000100:00100000:0.0:1789446238.257004:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794635904 00000100:00100000:0.0:1789446238.257045:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789446238.257055:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+18:23556:x1876369794635904:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789446238.257076:0:22818:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789446238.257088:0:22818:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1789446238.260051:0:22804:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1789446238.261120:0:22818:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789446238.261132:0:22818:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1789446238.262005:0:22840:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789446238.262012:0:22840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789446238.262044:0:22840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2d36a50800/0x62554ff3745507ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446238.262062:0:22840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2d35ea6e00/0x62554ff3745506d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff3745506cb expref: 18 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446238.262070:0:22840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2d42054c00/0x62554ff374550796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff37455078f expref: 18 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446238.262077:0:22840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c2d36a50800/0x62554ff3745507ce lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446238.262116:0:22840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2d42054c00/0x62554ff374550796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x62554ff37455078f expref: 18 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446238.262130:0:22840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2d42054c00/0x62554ff374550796 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x62554ff37455078f expref: 18 pid: 22819 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446238.262143:0:22840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22840:1876369794636032:0@lo:104: 00000100:00100000:0.0:1789446238.262202:0:22840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789446238.262281:0:22840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2d35ea6e00/0x62554ff3745506d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x62554ff3745506cb expref: 18 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446238.262302:0:22840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2d35ea6e00/0x62554ff3745506d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x62554ff3745506cb expref: 18 pid: 22818 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446238.262311:0:22840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22840:1876369794636160:0@lo:104: 00000100:00100000:0.0:1789446238.262334:0:22840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446238.262358:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d3d099240 going to sleep for 11 seconds 00000100:00100000:0.0:1789446238.262408:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794636032 00000100:00100000:0.0:1789446238.262414:0:22808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794636032 00000100:00100000:0.0:1789446238.262583:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794636160 00000100:00100000:0.0:1789446238.262587:0:22808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794636160 00000100:00100000:0.0:1789446238.262603:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789446238.262611:0:22808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2fa3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:282408b2-7484-4ad3-93ba-27093493daa8+4:22840:x1876369794636032:12345-0@lo:104: 00010000:00010000:0.0:1789446238.262623:0:22808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51a00/0x62554ff37455078f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff374550796 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446238.262681:0:22808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789446238.262687:0:22808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2fa3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:282408b2-7484-4ad3-93ba-27093493daa8+4:22840:x1876369794636032:12345-0@lo:104: Request processed in 78us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446238.262694:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789446238.262899:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+18:23556:x1876369794635904:12345-0@lo:253:mount.lustre.0 Request processed in 5845us (7033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446238.262909:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789446238.262991:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789446238.262999:0:22807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2fa3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:282408b2-7484-4ad3-93ba-27093493daa8+4:22840:x1876369794636160:12345-0@lo:104: 00010000:00010000:3.0:1789446238.263008:0:22807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6000/0x62554ff3745506cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff3745506d2 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.263050:0:22807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789446238.263056:0:22807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2fa3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:282408b2-7484-4ad3-93ba-27093493daa8+4:22840:x1876369794636160:12345-0@lo:104: Request processed in 59us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446238.263061:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789446238.263228:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789446238.263237:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51a00/0x62554ff37455078f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff374550796 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446238.263246:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36a51a00 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:2.0:1789446238.263251:0:22812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51a00/0x62554ff37455078f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x62554ff374550796 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446238.263261:0:22812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51a00/0x62554ff37455078f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x62554ff374550796 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789446238.263268:0:22812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51a00/0x62554ff37455078f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x62554ff374550796 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789446238.263274:0:22812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789446238.263319:0:22812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51a00/0x62554ff37455078f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff374550796 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446238.263326:0:22812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789446238.263347:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51a00/0x62554ff37455078f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff374550796 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446238.263353:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:282408b2-7484-4ad3-93ba-27093493daa8:3657:1876369794636288:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789446238.263356:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51a00/0x62554ff37455078f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff374550796 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446238.263377:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789446238.263382:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6000/0x62554ff3745506cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff3745506d2 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446238.263390:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789446238.263393:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d35ea6000 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:2.0:1789446238.263398:0:22812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6000/0x62554ff3745506cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x62554ff3745506d2 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446238.263406:0:22812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6000/0x62554ff3745506cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x62554ff3745506d2 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789446238.263414:0:22812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6000/0x62554ff3745506cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x62554ff3745506d2 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789446238.263420:0:22812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1789446238.263427:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794636288 00000100:00100000:3.0:1789446238.263433:0:22809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794636288 00010000:00010000:2.0:1789446238.263439:0:22812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6000/0x62554ff3745506cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745506d2 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446238.263446:0:22812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789446238.263455:0:22809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2d42054c00/0x62554ff374550796 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff37455078f expref: 18 pid: 22819 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446238.263457:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6000/0x62554ff3745506cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745506d2 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446238.263485:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea6000/0x62554ff3745506cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745506d2 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446238.263491:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789446238.263504:0:22809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:282408b2-7484-4ad3-93ba-27093493daa8+18:3657:x1876369794636288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789446238.263506:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446238.263510:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446238.263512:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446238.263516:0:22809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789446238.263523:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:282408b2-7484-4ad3-93ba-27093493daa8:3658:1876369794636416:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789446238.263537:0:22809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2d42054c00/0x62554ff374550796 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff37455078f expref: 18 pid: 22819 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446238.263560:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789446238.263562:0:22809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2d42054c00/0x62554ff374550796 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x62554ff37455078f expref: 18 pid: 22819 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.263579:0:22809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789446238.263596:0:22811:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789446238.263603:0:22811:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1789446238.263613:0:22809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:282408b2-7484-4ad3-93ba-27093493daa8+18:3657:x1876369794636288:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446238.263621:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789446238.263635:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794636416 00000100:00100000:3.0:1789446238.263639:0:22809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794636416 00010000:00010000:0.0:1789446238.263641:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446238.263651:0:22809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2d35ea6e00/0x62554ff3745506d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff3745506cb expref: 18 pid: 22818 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446238.263662:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789446238.263664:0:22840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d42054c00/0x62554ff374550796 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x62554ff37455078f expref: 18 pid: 22819 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446238.263669:0:22809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:282408b2-7484-4ad3-93ba-27093493daa8+18:3658:x1876369794636416:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789446238.263675:0:22840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22840:1876369794636032:0@lo:104: 00010000:00010000:3.0:1789446238.263678:0:22809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789446238.263681:0:22809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2d35ea6e00/0x62554ff3745506d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff3745506cb expref: 17 pid: 22818 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446238.263686:0:22840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22840:1876369794636160:0@lo:104: 00010000:00010000:3.0:1789446238.263689:0:22809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2d35ea6e00/0x62554ff3745506d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x62554ff3745506cb expref: 17 pid: 22818 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.263698:0:22809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d35ea6e00/0x62554ff3745506d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x62554ff3745506cb expref: 17 pid: 22818 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446238.263730:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:282408b2-7484-4ad3-93ba-27093493daa8:3657:1876369794636288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789446238.264215:0:23556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:23556:1876369794635904:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789446238.264226:0:23556:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789446238.264230:0:23556:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789446238.264232:0:23556:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789446238.264234:0:23556:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789446238.264235:0:23556:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789446238.264237:0:23556:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789446238.264238:0:23556:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789446238.264239:0:23556:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789446238.264241:0:23556:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789446238.264242:0:23556:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789446238.264254:0:23556:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1789446238.265101:0:22840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c2d36a50800/0x62554ff3745507ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.266434:0:22809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c2d36a50800/0x62554ff3745507ce lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.266447:0:22809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d36a50800/0x62554ff3745507ce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789446238.266479:0:22809:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004468057s 00010000:00010000:3.0:1789446238.266485:0:22809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2d36a50800/0x62554ff3745507ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.266492:0:22809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2d36a50800/0x62554ff3745507ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.266498:0:22809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2d36a50800/0x62554ff3745507ce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.266506:0:22809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2d36a50800/0x62554ff3745507ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.266512:0:22809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36a50800 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446238.266516:0:22809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2d36a50800/0x62554ff3745507ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.266618:0:22809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2d36a50800/0x62554ff3745507ce lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.266630:0:22809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2d36a50800/0x62554ff3745507ce lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446238.266641:0:22809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789446238.266719:0:22809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:282408b2-7484-4ad3-93ba-27093493daa8+16:3658:x1876369794636416:12345-0@lo:103:ldlm_bl.0 Request processed in 3048us (3158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446238.266730:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789446238.267045:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:282408b2-7484-4ad3-93ba-27093493daa8:3658:1876369794636416:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789446238.268497:0:22840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c2d36a50800/0x62554ff3745507ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446238.268512:0:22840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2d36a50800/0x62554ff3745507ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446238.268672:0:22840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d36a50800/0x62554ff3745507ce lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1789446238.272599:0:23556:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1789446238.272809:0:23582:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789446238.272818:0:23582:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789446238.272912:0:23583:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789446238.273242:0:23556:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1789446238.273444:0:23583:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1789446238.276715:0:23556:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1789446238.276808:0:23556:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789446238.277352:0:23556:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789446238.277363:0:23556:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1789446238.277419:0:23556:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789446238.278467:0:23556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789446238.279055:0:23556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789446238.279090:0:23556:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1789446238.279185:0:23556:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789446238.283287:0:23583:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789446238.285167:0:23583:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1789446238.287127:0:23584:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a93b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23584:1876369794636544:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789446238.287195:0:23584:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446238.287232:0:23584:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d04bcba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789446238.287253:0:22829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794636544 00000100:00100000:0.0:1789446238.287270:0:22829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794636544 00000100:00100000:0.0:1789446238.287395:0:22829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789446238.287406:0:22829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23584:x1876369794636544:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789446238.287516:0:22829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23584:x1876369794636544:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 112us (321us total) trans 0 rc 0/0 00080000:10000000:2.0:1789446238.288157:0:23556:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:0.0:1789446238.289027:0:22829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789446238.289084:0:23584:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a93b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23584:1876369794636544:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1789446238.289116:0:23584:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789446238.289154:0:23584:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23584:1876369794636672:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789446238.289202:0:23584:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446238.289260:0:23584:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d3d0996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789446238.289323:0:23565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794636672 00000100:00100000:3.0:1789446238.289329:0:23565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794636672 00000100:00100000:3.0:1789446238.289371:0:23565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789446238.289379:0:23565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2fa3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23584:x1876369794636672:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789446238.290366:0:23565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2fa3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23584:x1876369794636672:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 985us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446238.290376:0:23565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000001:00000004:2.0:1789446238.291930:0:23556:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1789446238.292165:0:23584:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23584:1876369794636672:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789446238.292253:0:23584:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23584:1876369794636800:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789446238.292319:0:23584:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446238.292383:0:23584:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d3d099240 going to sleep for 11 seconds 00000100:00100000:3.0:1789446238.292661:0:22835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794636800 00000100:00100000:3.0:1789446238.292667:0:22835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794636800 00000100:00100000:3.0:1789446238.292775:0:22835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789446238.292785:0:22835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2fa3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23584:x1876369794636800:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789446238.292841:0:22835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2fa3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23584:x1876369794636800:12345-0@lo:900:lod0001_rec0000.0 Request processed in 58us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446238.292849:0:22835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789446238.293126:0:23584:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c2d2fa3ea00 x1876369794636800/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789446254 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789446238.293139:0:23584:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23584:1876369794636800:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789446238.293187:0:23584:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d1180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23584:1876369794636928:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789446238.293219:0:23584:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446238.293239:0:23584:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c078926c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789446238.294288:0:22829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794636928 00000100:00100000:0.0:1789446238.294309:0:22829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794636928 00000001:00080000:2.0:1789446238.294377:0:23556:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000100:00100000:0.0:1789446238.294423:0:22829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789446238.294432:0:22829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23584:x1876369794636928:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789446238.294574:0:22829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23584:x1876369794636928:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 142us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446238.294580:0:22829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789446238.294584:0:23584:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d1180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23584:1876369794636928:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1789446238.294642:0:23584:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789446238.295604:0:23556:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffae10814a7988 00100000:10000000:2.0:1789446238.295613:0:23556:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000040:00080000:1.0:1789446238.298544:0:23584:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789446238.298624:0:23584:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789446238.298628:0:23584:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:01000004:3.0:1789446238.303133:0:23556:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789446238.303165:0:23556:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789446238.303182:0:23556:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789446238.303199:0:23556:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1789446238.304951:0:23556:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789446238.305176:0:23556:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789446238.381601:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446238.694175:0:22866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067ef900 going to sleep for 0 seconds 00000040:00080000:2.0:1789446239.270572:0:23579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789446239.398134:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446239.722391:0:22866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067ef900 going to sleep for 0 seconds 10000000:01000000:3.0:1789446240.297894:0:22821:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789446240.297901:0:22821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c2d3fe3e000 from 12 10000000:01000000:3.0:1789446240.297906:0:22821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789446240.297944:0:22821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d42055800/0x62554ff3745507d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446240.297954:0:22821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d42055800/0x62554ff3745507d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446240.297985:0:22821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d42055800/0x62554ff3745507d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446240.298008:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794637056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789446240.299594:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446240.299640:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d04bcb600 going to sleep for 11 seconds 00000100:00100000:3.0:1789446240.299675:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794637056 00000100:00100000:3.0:1789446240.299683:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794637056 00000100:00100000:3.0:1789446240.299732:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789446240.299740:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+16:22821:x1876369794637056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789446240.299754:0:22816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446240.299771:0:22816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d42054c00/0x62554ff3745507dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff3745507d5 expref: -99 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446240.299794:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d42054c00/0x62554ff3745507dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff3745507d5 expref: 17 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446240.299805:0:22816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d42054c00/0x62554ff3745507dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff3745507d5 expref: 17 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446240.299812:0:22816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d42054c00, rc 0) 00000100:00100000:3.0:1789446240.299865:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+17:22821:x1876369794637056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446240.299871:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789446240.299914:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794637056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789446240.299929:0:22821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d42055800/0x62554ff3745507d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745507dc expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446240.299937:0:22821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d42055800/0x62554ff3745507d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff3745507dc expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446240.300008:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794637184:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789446240.300040:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446240.300466:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794637184 00000100:00100000:1.0:1789446240.300472:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794637184 00000100:00100000:1.0:1789446240.300511:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789446240.300518:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+17:22821:x1876369794637184:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789446240.300533:0:22819:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789446240.300547:0:22819:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789446240.300550:0:22819:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1789446240.300616:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+17:22821:x1876369794637184:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 98us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446240.300623:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000040:00080000:2.0:1789446240.301322:0:23579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789446240.302180:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d04bcb600 going to sleep for 11 seconds 00000100:00100000:3.0:1789446240.302210:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794637184:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789446240.302272:0:22821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789446240.302290:0:22821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d42055800/0x62554ff3745507d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745507dc expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446240.302301:0:22821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d42055800/0x62554ff3745507d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745507dc expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789446240.302311:0:22821:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789446240.302313:0:22821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c2d41bbc000 from 12 10000000:01000000:3.0:1789446240.302316:0:22821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789446240.302345:0:22821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff3745507e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446240.302353:0:22821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff3745507e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446240.303764:0:22821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff3745507e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446240.303787:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794637312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789446240.303849:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446240.303889:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d04bcb600 going to sleep for 11 seconds 00000100:00100000:3.0:1789446240.303909:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794637312 00000100:00100000:3.0:1789446240.303914:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794637312 00000100:00100000:3.0:1789446240.303954:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789446240.303978:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3eded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+17:22821:x1876369794637312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789446240.303991:0:22818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446240.304005:0:22818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d36806800/0x62554ff3745507ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff3745507e3 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446240.304027:0:22818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d36806800/0x62554ff3745507ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff3745507e3 expref: 18 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446240.304038:0:22818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d36806800/0x62554ff3745507ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff3745507e3 expref: 18 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446240.304046:0:22818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d36806800, rc 0) 00000100:00100000:3.0:1789446240.305201:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3eded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+18:22821:x1876369794637312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1220us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446240.305212:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789446240.306179:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794637312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789446240.306202:0:22821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff3745507e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745507ea expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446240.306213:0:22821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff3745507e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff3745507ea expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446240.306296:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794637440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789446240.306338:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446240.307159:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d08104a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789446240.307590:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794637440 00000100:00100000:3.0:1789446240.307598:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794637440 00000100:00100000:3.0:1789446240.307638:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789446240.307646:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+18:22821:x1876369794637440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789446240.307671:0:22818:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789446240.307685:0:22818:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789446240.307688:0:22818:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1789446240.307775:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+18:22821:x1876369794637440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446240.307783:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789446240.308170:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794637440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789446240.308295:0:22821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789446240.308304:0:22821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff3745507e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745507ea expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446240.308315:0:22821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff3745507e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745507ea expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446240.426171:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446240.749590:0:22866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067ef900 going to sleep for 0 seconds 00010000:00010000:3.0:1789446241.447447:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446241.766096:0:22866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067ef900 going to sleep for 0 seconds 00010000:00010000:1.0:1789446242.470117:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446242.790468:0:22866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067ef900 going to sleep for 0 seconds 00000001:02000400:1.0:1789446242.829092:0:23827:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789446243.494189:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789446243.558150:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789446243.558157:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789446243.558160:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c2c05b67000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1789446243.558167:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:282408b2-7484-4ad3-93ba-27093493daa8:3659:1876369794637568:0@lo:400:kworker.0 00000100:00080000:2.0:1789446243.558193:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c2c05b67000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1789446243.558216:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2d41b7df80 x1876369794637696/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789446243.558234:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1789446243.558241:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789446243.558242:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789446243.558248:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789446243.558252:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789446243.558302:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789446243.558306:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789446243.558309:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789446243.558312:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789446243.558332:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789446243.558340:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794637952:0@lo:400:kworker.0 00000100:00100000:0.0:1789446243.558342:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876369794637824:0@lo:400:kworker.0 00000100:00100000:2.0:1789446243.558386:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446243.558392:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446243.560070:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1876369794638080:0@lo:400:kworker.0 00000100:00100000:2.0:1789446243.560688:0:23565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794637952 00000100:00100000:2.0:1789446243.560711:0:23565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794637952 00000100:00100000:2.0:1789446243.560775:0:23565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789446243.560785:0:23565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794637952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446243.560854:0:23565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794637952:12345-0@lo:400:kworker.0 Request processed in 71us (2468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446243.560861:0:23565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789446243.560901:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794637952:0@lo:400:kworker.0 00000100:00100000:0.0:1789446243.561103:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794638208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789446243.561141:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446243.561210:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794637696:0@lo:38:kworker.0 00000100:00100000:0.0:1789446243.561237:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446243.561329:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794637568 00000100:00100000:0.0:1789446243.561334:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794637568 00000100:00100000:0.0:1789446243.561368:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789446243.561376:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+18:3659:x1876369794637568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446243.561422:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+18:3659:x1876369794637568:12345-0@lo:400:kworker.0 Request processed in 47us (3184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446243.561428:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789446243.561457:0:22825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794637824 00000100:00100000:0.0:1789446243.561461:0:22825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794637824 00000100:00100000:0.0:1789446243.561486:0:22825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789446243.561493:0:22825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2fa3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876369794637824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446243.561532:0:22825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2fa3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876369794637824:12345-0@lo:400:kworker.0 Request processed in 40us (3143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446243.561538:0:22825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789446243.561574:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c2d41b7c700 x1876369794637824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446243.561586:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876369794637824:0@lo:400:kworker.0 00000100:00100000:0.0:1789446243.561611:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:282408b2-7484-4ad3-93ba-27093493daa8:3659:1876369794637568:0@lo:400:kworker.0 00000100:00100000:1.0:1789446243.563456:0:23565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794638208 00000100:00100000:1.0:1789446243.563469:0:23565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794638208 00000100:00100000:1.0:1789446243.563512:0:23565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794637696 00000100:00100000:1.0:1789446243.563515:0:23565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794637696 00000100:00100000:1.0:1789446243.563530:0:23565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789446243.563538:0:23565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2fa3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794638208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789446243.563571:0:23565:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789446243.563642:0:23565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2fa3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794638208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (2501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446243.563660:0:23565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789446243.563676:0:23565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789446243.563680:0:23565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2fa3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3656:x1876369794637696:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789446243.563704:0:23565:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 625 last 0 00000020:00000080:1.0:1789446243.563741:0:23565:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x62554ff3745507f1 00000004:00100000:1.0:1789446243.563753:0:23565:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789446243.563758:0:23565:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1789446243.563856:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794638208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789446243.564121:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446243.564194:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794638080 00000100:00100000:0.0:1789446243.564199:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794638080 00000100:00100000:0.0:1789446243.564238:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789446243.564245:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1876369794638080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446243.564338:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1876369794638080:12345-0@lo:400:kworker.0 Request processed in 93us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446243.564345:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789446243.566790:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c2d41b7f800 x1876369794638080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789446243.566807:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1876369794638080:0@lo:400:kworker.0 00000100:00080000:1.0:1789446243.574590:0:23565:0:(import.c:65:import_set_state_nolock()) ffff9c2c05a5f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789446243.574690:0:23565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2fa3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3656:x1876369794637696:12345-0@lo:38:kworker.0 Request processed in 11006us (13450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446243.574702:0:23565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1789446243.574825:0:3656:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1789446243.574835:0:3656:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789446243.574839:0:3656:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789446243.574842:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2c05b67000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789446243.574861:0:3656:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008357b731): req@ffff9c2d41b7ca80 x1876369794630784/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446243.574884:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794637696:0@lo:38:kworker.0 00000100:00100000:1.0:1789446243.574999:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789446243.575011:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794638336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789446243.575012:0:22866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446243.575047:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446243.575048:0:22866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067ef900 going to sleep for 11 seconds 00000100:00100000:3.0:1789446243.589602:0:22829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794630784 00000100:00100000:3.0:1789446243.589616:0:22829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794630784 00000100:00100000:3.0:1789446243.589674:0:22829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794638336 00000100:00100000:3.0:1789446243.589678:0:22829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794638336 00000100:00100000:3.0:1789446243.589709:0:22829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789446243.589719:0:22829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22866:x1876369794630784:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789446243.589832:0:22829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22866:x1876369794630784:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 114us (14821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446243.589839:0:22829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789446243.589855:0:22829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789446243.589862:0:22829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3659:x1876369794638336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789446243.589882:0:22829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789446243.589933:0:22829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3659:x1876369794638336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (14887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446243.589939:0:22829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789446243.590025:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794638336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789446243.590064:0:22866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7ca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22866:1876369794630784:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1789446243.590095:0:22866:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789446243.590138:0:22866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22866:1876369794638464:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789446243.590175:0:22866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446243.590205:0:22866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d089edd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789446243.590217:0:22829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794638464 00000100:00100000:3.0:1789446243.590221:0:22829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794638464 00000100:00100000:3.0:1789446243.590242:0:22829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789446243.590247:0:22829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22866:x1876369794638464:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789446243.590353:0:22829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22866:x1876369794638464:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 105us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446243.590360:0:22829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789446243.590385:0:22866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22866:1876369794638464:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789446243.590641:0:22866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22866:1876369794638592:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789446243.590666:0:22866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446243.590681:0:22866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d089edd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789446243.590759:0:22829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794638592 00000100:00100000:3.0:1789446243.590763:0:22829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794638592 00000100:00100000:3.0:1789446243.590787:0:22829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789446243.590793:0:22829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22866:x1876369794638592:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789446243.590848:0:22829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22866:x1876369794638592:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 54us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446243.590863:0:22829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789446243.590869:0:22866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22866:1876369794638592:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1789446243.590916:0:22866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789446243.592906:0:22866:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789446243.593010:0:22866:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:2.0:1789446243.593016:0:22866:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1789446243.889445:0:23879:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789446243.890057:0:23879:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789446244.518194:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789446245.013218:0:23929:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789446245.013469:0:23929:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789446245.551899:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789446246.103465:0:23977:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff4ca1b4b0 20000000:00000080:0.0:1789446246.103490:0:23977:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c2d37a22000 uarg=0000000000000000 20000000:01000000:0.0:1789446246.103545:0:23977:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789446246.103553:0:23977:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789446246.103559:0:23977:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789446246.109628:0:23978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1789446246.109952:0:23977:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789446246.119458:0:23977:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789446246.120925:0:23977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2d2fa9d200/0x62554ff3745507f8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446246.120949:0:23977:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2d42054000/0x62554ff3745506a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff37455069a expref: 17 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446246.122456:0:23977:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2d00031200/0x62554ff3745507a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff37455079d expref: 17 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446246.122496:0:23977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c2d2fa9d200/0x62554ff3745507f8 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446246.122554:0:23977:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2d00031200/0x62554ff3745507a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x62554ff37455079d expref: 17 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446246.122573:0:23977:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2d00031200/0x62554ff3745507a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x62554ff37455079d expref: 17 pid: 22818 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446246.122592:0:23977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23977:1876369794638720:0@lo:104: 00000100:00100000:1.0:1789446246.122923:0:23977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789446246.123018:0:23977:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2d42054000/0x62554ff3745506a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x62554ff37455069a expref: 17 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446246.123027:0:23977:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2d42054000/0x62554ff3745506a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x62554ff37455069a expref: 17 pid: 22818 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446246.123036:0:23977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23977:1876369794638848:0@lo:104: 00000100:00100000:0.0:1789446246.123213:0:22808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794638720 00000100:00100000:0.0:1789446246.123224:0:22808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794638720 00000100:00100000:0.0:1789446246.123295:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789446246.123306:0:22808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:282408b2-7484-4ad3-93ba-27093493daa8+3:23977:x1876369794638720:12345-0@lo:104: 00010000:00010000:0.0:1789446246.123323:0:22808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9c2d00030000/0x62554ff37455079d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff3745507a4 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446246.123425:0:22808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789446246.123431:0:22808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:282408b2-7484-4ad3-93ba-27093493daa8+3:23977:x1876369794638720:12345-0@lo:104: Request processed in 128us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446246.123438:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789446246.123585:0:23977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446246.123617:0:23977:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c07892e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789446246.123640:0:23977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23977:1876369794638720:0@lo:104: 00000100:00100000:2.0:1789446246.123781:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794638848 00000100:00100000:2.0:1789446246.123786:0:22807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794638848 00000100:00100000:2.0:1789446246.123807:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789446246.123813:0:22807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:282408b2-7484-4ad3-93ba-27093493daa8+3:23977:x1876369794638848:12345-0@lo:104: 00010000:00010000:2.0:1789446246.123824:0:22807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7600/0x62554ff37455069a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff3745506a1 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446246.123882:0:22807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789446246.123887:0:22807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:282408b2-7484-4ad3-93ba-27093493daa8+3:23977:x1876369794638848:12345-0@lo:104: Request processed in 75us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446246.123893:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789446246.123911:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789446246.123918:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d00030000/0x62554ff37455079d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff3745507a4 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446246.123925:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d00030000 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:2.0:1789446246.123930:0:22812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d00030000/0x62554ff37455079d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x62554ff3745507a4 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446246.123939:0:22812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d00030000/0x62554ff37455079d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x62554ff3745507a4 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789446246.123946:0:22812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d00030000/0x62554ff37455079d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x62554ff3745507a4 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789446246.124003:0:22812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789446246.124039:0:22812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9c2d00030000/0x62554ff37455079d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745507a4 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446246.124046:0:22812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789446246.124082:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d00030000/0x62554ff37455079d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745507a4 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446246.124089:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d00030000/0x62554ff37455079d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745507a4 expref: -99 pid: 23556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446246.124091:0:23977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23977:1876369794638848:0@lo:104: 00010000:00010000:2.0:1789446246.124104:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789446246.124107:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7600/0x62554ff37455069a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff3745506a1 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446246.124112:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d35ea7600 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:2.0:1789446246.124115:0:22812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7600/0x62554ff37455069a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x62554ff3745506a1 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446246.124118:0:23977:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c2d2fa9d200/0x62554ff3745507f8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446246.124133:0:22812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7600/0x62554ff37455069a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x62554ff3745506a1 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789446246.124139:0:22812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7600/0x62554ff37455069a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x62554ff3745506a1 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789446246.124143:0:22812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789446246.124157:0:22812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7600/0x62554ff37455069a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745506a1 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446246.124163:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446246.124163:0:22812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789446246.124176:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7600/0x62554ff37455069a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745506a1 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446246.124183:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7600/0x62554ff37455069a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745506a1 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446246.124195:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:282408b2-7484-4ad3-93ba-27093493daa8:3657:1876369794638976:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789446246.124198:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446246.124199:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446246.124201:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446246.124210:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:282408b2-7484-4ad3-93ba-27093493daa8:3658:1876369794639104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789446246.124233:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446246.124279:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794638976 00000100:00100000:2.0:1789446246.124284:0:22809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794638976 00000100:00100000:3.0:1789446246.124294:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789446246.124306:0:22809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2d00031200/0x62554ff3745507a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff37455079d expref: 18 pid: 22818 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446246.124328:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794639104 00000100:00100000:2.0:1789446246.124331:0:22809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794639104 00000100:00100000:3.0:1789446246.124338:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789446246.124341:0:22809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2d42054000/0x62554ff3745506a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff37455069a expref: 19 pid: 22818 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446246.124346:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:282408b2-7484-4ad3-93ba-27093493daa8+19:3657:x1876369794638976:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789446246.124358:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789446246.124363:0:22809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:282408b2-7484-4ad3-93ba-27093493daa8+19:3658:x1876369794639104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789446246.124375:0:22809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789446246.124380:0:22809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2d42054000/0x62554ff3745506a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff37455069a expref: 19 pid: 22818 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446246.124390:0:22809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2d42054000/0x62554ff3745506a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x62554ff37455069a expref: 19 pid: 22818 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446246.124403:0:22809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d42054000/0x62554ff3745506a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x62554ff37455069a expref: 19 pid: 22818 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446246.124425:0:22809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789446246.124458:0:22809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:282408b2-7484-4ad3-93ba-27093493daa8+18:3658:x1876369794639104:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (163us total) trans 0 rc 0/0 00010000:00010000:3.0:1789446246.124501:0:22810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789446246.124507:0:22810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2d00031200/0x62554ff3745507a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff37455079d expref: 18 pid: 22818 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446246.124519:0:22810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2d00031200/0x62554ff3745507a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x62554ff37455079d expref: 18 pid: 22818 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446246.124530:0:22810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d00031200/0x62554ff3745507a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x62554ff37455079d expref: 18 pid: 22818 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446246.124543:0:22810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c2d2fa9d200/0x62554ff3745507f8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446246.124552:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d2fa9d200/0x62554ff3745507f8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446246.124568:0:22810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2d2fa9d200/0x62554ff3745507f8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446246.124583:0:22810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2d2fa9d200/0x62554ff3745507f8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446246.124590:0:22810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2d2fa9d200/0x62554ff3745507f8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446246.124596:0:22810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2d2fa9d200/0x62554ff3745507f8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446246.124602:0:22810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9d200 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446246.124606:0:22810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2d2fa9d200/0x62554ff3745507f8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446246.124614:0:22810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2d2fa9d200/0x62554ff3745507f8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446246.124628:0:22810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2d2fa9d200/0x62554ff3745507f8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446246.124638:0:22810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789446246.124986:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789446246.130987:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:282408b2-7484-4ad3-93ba-27093493daa8:3658:1876369794639104:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789446246.131251:0:23977:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c2d2fa9d200/0x62554ff3745507f8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446246.131296:0:23977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2d2fa9d200/0x62554ff3745507f8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446246.131304:0:23977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d2fa9d200/0x62554ff3745507f8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446246.132528:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:282408b2-7484-4ad3-93ba-27093493daa8+16:3657:x1876369794638976:12345-0@lo:103:ldlm_bl.0 Request processed in 8173us (8284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446246.132545:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789446246.132988:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:282408b2-7484-4ad3-93ba-27093493daa8:3657:1876369794638976:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789446246.568299:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789446246.886633:0:22862:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789446247.598800:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789446247.911355:0:22821:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789446247.911366:0:22821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c2d3fe3e000 from 13 10000000:01000000:2.0:1789446247.911373:0:22821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789446247.911437:0:22821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7200/0x62554ff3745507ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446247.911451:0:22821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7200/0x62554ff3745507ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446247.911465:0:22821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7200/0x62554ff3745507ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446247.911498:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794639232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789446247.911589:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446247.911644:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d08104480 going to sleep for 11 seconds 00000100:00100000:3.0:1789446247.911865:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794639232 00000100:00100000:3.0:1789446247.911876:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794639232 00000100:00100000:3.0:1789446247.911941:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789446247.911952:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+16:22821:x1876369794639232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789446247.911995:0:22816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446247.912263:0:22816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d36806c00/0x62554ff374550806 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff3745507ff expref: -99 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446247.912292:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d36806c00/0x62554ff374550806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff3745507ff expref: 17 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446247.912304:0:22816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d36806c00/0x62554ff374550806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff3745507ff expref: 17 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446247.912315:0:22816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d36806c00, rc 0) 00000100:00100000:3.0:1789446247.912377:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+17:22821:x1876369794639232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 426us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446247.912385:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789446247.912484:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794639232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789446247.912502:0:22821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7200/0x62554ff3745507ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550806 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446247.912512:0:22821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7200/0x62554ff3745507ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff374550806 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446247.912602:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794639360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789446247.912634:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446247.912710:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d08104480 going to sleep for 11 seconds 00000100:00100000:0.0:1789446247.919200:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794639360 00000100:00100000:0.0:1789446247.919220:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794639360 00000100:00100000:0.0:1789446247.919322:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789446247.919335:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ededc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+17:22821:x1876369794639360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789446247.919603:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ededc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+17:22821:x1876369794639360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 270us (6967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446247.919611:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789446247.919817:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794639360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789446247.919883:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794639488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789446247.919946:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446247.920017:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d08104480 going to sleep for 11 seconds 00000100:00100000:3.0:1789446247.920272:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794639488 00000100:00100000:3.0:1789446247.920278:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794639488 00000100:00100000:3.0:1789446247.920327:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789446247.920337:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d04a52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+17:22821:x1876369794639488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789446247.920461:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d04a52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+17:22821:x1876369794639488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446247.920470:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789446247.920608:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794639488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789446247.923560:0:24046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789446247.928485:0:22821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789446247.928544:0:22821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789446247.928560:0:22821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7200/0x62554ff3745507ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550806 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446247.928576:0:22821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7200/0x62554ff3745507ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550806 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789446247.929240:0:22821:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789446247.929269:0:22821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c2d41bbc000 from 13 10000000:01000000:3.0:1789446247.929275:0:22821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789446247.929327:0:22821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37455080d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446247.929338:0:22821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37455080d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446247.929352:0:22821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37455080d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446247.929384:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794639616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789446247.929468:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446247.929589:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d35d85d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789446247.932158:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794639616 00000100:00100000:0.0:1789446247.932178:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794639616 00000100:00100000:0.0:1789446247.932415:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789446247.932430:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d04a51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+17:22821:x1876369794639616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789446247.932453:0:22819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789446247.932476:0:22819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d36a50c00/0x62554ff374550814 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff37455080d expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446247.932523:0:22819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d36a50c00/0x62554ff374550814 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff37455080d expref: 18 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446247.932538:0:22819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d36a50c00/0x62554ff374550814 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff37455080d expref: 18 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446247.932549:0:22819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d36a50c00, rc 0) 00000100:00100000:0.0:1789446247.932727:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d04a51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+18:22821:x1876369794639616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 301us (3258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446247.932734:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789446247.932859:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794639616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789446247.932884:0:22821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37455080d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550814 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446247.932894:0:22821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37455080d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff374550814 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446247.933020:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794639744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789446247.933060:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446247.933286:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d35d85d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789446247.933361:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794639744 00000100:00100000:1.0:1789446247.933368:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794639744 00000100:00100000:1.0:1789446247.933404:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789446247.933412:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d04a53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+18:22821:x1876369794639744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789446247.935853:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d04a53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+18:22821:x1876369794639744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2430us (2781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446247.935869:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789446247.938468:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794639744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789446247.938944:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794639872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789446247.939785:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446247.939837:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d35d85d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789446247.939933:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794639872 00000100:00100000:0.0:1789446247.939942:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794639872 00000100:00100000:0.0:1789446247.940045:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789446247.940057:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d04a51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+18:22821:x1876369794639872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789446247.940277:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d04a51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+18:22821:x1876369794639872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 221us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446247.940286:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789446247.940777:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794639872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789446247.949731:0:24047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789446247.953631:0:22821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789446247.953682:0:22821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789446247.953699:0:22821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37455080d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550814 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446247.953713:0:22821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37455080d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550814 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446248.617476:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789446248.678349:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789446248.678357:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789446248.678360:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789446248.678363:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789446248.678391:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789446248.678395:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789446248.678398:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789446248.678401:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789446248.678446:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876369794640128:0@lo:400:kworker.0 00000100:00100000:0.0:1789446248.678509:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794640000:0@lo:400:kworker.0 00000100:00100000:1.0:1789446248.678656:0:3656:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789446238/real 1789446238] req@ffff9c2c082d2d80 x1876369794633984/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789446248 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446248.678734:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:3.0:1789446248.680105:0:23557:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789446248.680325:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446248.680395:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794640000 00000100:00100000:3.0:1789446248.680407:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794640000 00000100:00100000:0.0:1789446248.680453:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794640512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789446248.680473:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789446248.680485:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2fa3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794640000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446248.680501:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446248.680544:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789446248.680553:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794640640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789446248.680589:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2fa3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794640000:12345-0@lo:400:kworker.0 Request processed in 105us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446248.680604:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446248.680612:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789446248.680647:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794640512 00000100:00100000:3.0:1789446248.680652:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794640512 00000100:00100000:0.0:1789446248.680668:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794640000:0@lo:400:kworker.0 00000100:00100000:3.0:1789446248.680671:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794640640 00000100:00100000:3.0:1789446248.680677:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794640640 00000100:00100000:3.0:1789446248.680696:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789446248.680705:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2fa3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794640512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789446248.680733:0:22830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789446248.680802:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2fa3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794640512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446248.680810:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789446248.680821:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794640512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789446248.680831:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789446248.680844:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2fa3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794640640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789446248.680864:0:22830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789446248.680878:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794640128 00000100:00100000:0.0:1789446248.680887:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794640128 00000100:00100000:3.0:1789446248.680909:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2fa3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794640640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446248.680917:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789446248.680939:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789446248.680951:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876369794640128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446248.681706:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876369794640128:12345-0@lo:400:kworker.0 Request processed in 755us (2970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446248.681716:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789446248.681779:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794640640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789446248.682130:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794640256:0@lo:400:kworker.0 00000100:00100000:3.0:1789446248.682346:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446248.682532:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789446248.682540:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1876369794640384:0@lo:400:kworker.0 00000100:00100000:1.0:1789446248.682631:0:3656:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c2c082d2d80 x1876369794633984/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789446248 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789446248.682651:0:3656:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789446238/real 1789446238] req@ffff9c2c082d0a80 x1876369794633856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789446248 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789446248.682665:0:3656:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c2c082d0a80 x1876369794633856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789446248 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789446248.682682:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d3fea6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789446248.682713:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789446248.682718:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794633984:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789446248.682724:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d31d3c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789446248.682730:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789446248.682733:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794633856:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789446248.683132:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789446248.683139:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789446248.683142:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789446248.683145:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789446248.683149:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789446248.683152:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789446248.683156:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c2d31d3c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789446248.683161:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 620 00000100:00100000:0.0:1789446248.683268:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794640256 00000100:00100000:0.0:1789446248.683280:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794640256 00000100:00100000:0.0:1789446248.683337:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789446248.683347:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794640256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446248.683467:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794640256:12345-0@lo:400:kworker.0 Request processed in 121us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446248.683474:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1789446248.683617:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789446248.683633:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c2d31d3c000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789446248.683671:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2c07a90a80 x1876369794640768/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789446248.683707:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789446248.683712:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789446248.683714:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c2d3fea6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789446248.683721:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 620 00000100:00080000:3.0:1789446248.683727:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789446248.683735:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c2d3fea6800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789446248.683748:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2c07a90380 x1876369794640896/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789446248.684278:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794640768:0@lo:8:kworker.0 00000400:00000100:0.0:1789446248.684338:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876369794640768 offset 0 length 520: 4 00000100:00100000:0.0:1789446248.684399:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794640896:0@lo:8:kworker.0 00000400:00000100:0.0:1789446248.684419:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876369794640896 offset 0 length 520: 4 00010000:00080000:2.0:1789446248.691363:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c2d41b7d180 x1876369794640128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446248.691388:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876369794640128:0@lo:400:kworker.0 00000100:00100000:0.0:1789446248.691836:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446248.691888:0:22825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794640384 00000100:00100000:1.0:1789446248.691903:0:22825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794640384 00000100:00100000:1.0:1789446248.691991:0:22825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789446248.692001:0:22825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2fa3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1876369794640384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446248.692613:0:22825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2fa3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1876369794640384:12345-0@lo:400:kworker.0 Request processed in 612us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446248.692634:0:22825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789446248.692688:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c2d41b7d880 x1876369794640384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789446248.692701:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1876369794640384:0@lo:400:kworker.0 00000100:00100000:1.0:1789446248.692715:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794640256:0@lo:400:kworker.0 00010000:00010000:1.0:1789446249.643826:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446249.702654:0:3656:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789446234/real 1789446234] req@ffff9c2d2fa3c700 x1876369794631808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789446249 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446249.702694:0:3656:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c2d2fa3c700 x1876369794631808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789446249 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446249.702716:0:3656:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789446234/real 1789446234] req@ffff9c2d2fa3c000 x1876369794631936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789446249 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446249.702729:0:3656:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c2d2fa3c000 x1876369794631936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789446249 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789446249.702753:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2c05b60800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789446249.702773:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789446249.702778:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794631808:0@lo:8:kworker.0 00000100:00080000:2.0:1789446249.702784:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d187ae000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789446249.702789:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789446249.702792:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794631936:0@lo:8:kworker.0 00000100:00100000:2.0:1789446249.703352:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789446249.703424:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789446249.703444:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1876369794641152:0@lo:400:kworker.0 00000100:00100000:0.0:1789446249.703525:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446249.703619:0:23565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794641152 00000100:00100000:0.0:1789446249.703629:0:23565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794641152 00000100:00100000:0.0:1789446249.703699:0:23565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789446249.703709:0:23565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2fa3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1876369794641152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446249.703777:0:23565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2fa3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1876369794641152:12345-0@lo:400:kworker.0 Request processed in 69us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446249.703786:0:23565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789446249.703832:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1876369794641152:0@lo:400:kworker.0 00000100:00100000:2.0:1789446249.707465:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:282408b2-7484-4ad3-93ba-27093493daa8:3658:1876369794641024:0@lo:400:kworker.0 00000100:00100000:2.0:1789446249.707563:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789446249.707771:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789446249.707785:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789446249.707790:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c2c05b60800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789446249.707797:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 616 00000100:00080000:3.0:1789446249.707804:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789446249.707816:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c2c05b60800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789446249.707861:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2c07a90000 x1876369794641280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789446249.708032:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789446249.708037:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789446249.708039:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c2d187ae000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789446249.708044:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 616 00000100:00080000:3.0:1789446249.708047:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789446249.708054:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c2d187ae000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789446249.708069:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2c07a93100 x1876369794641408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789446249.708111:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1789446249.708269:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1876369794641664:0@lo:400:kworker.0 00000100:00100000:2.0:1789446249.708316:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446249.708349:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789446249.708364:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876369794641536:0@lo:400:kworker.0 00000100:00100000:2.0:1789446249.708394:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446249.708434:0:22829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794641664 00000100:00100000:2.0:1789446249.708443:0:22829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794641664 00000100:00100000:2.0:1789446249.708501:0:22829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789446249.708513:0:22829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1876369794641664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446249.708574:0:22829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1876369794641664:12345-0@lo:400:kworker.0 Request processed in 65us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446249.708582:0:22829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789446249.708610:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794641536 00000100:00100000:2.0:1789446249.708613:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794641536 00000100:00100000:2.0:1789446249.708646:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789446249.708654:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876369794641536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446249.708687:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876369794641536:12345-0@lo:400:kworker.0 Request processed in 35us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446249.708693:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789446249.708740:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c2c07a91500 x1876369794641536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446249.708755:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876369794641536:0@lo:400:kworker.0 00000100:00100000:2.0:1789446249.708767:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1876369794641664:0@lo:400:kworker.0 00000100:00100000:2.0:1789446249.708799:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794641280:0@lo:8:kworker.0 00000400:00000100:2.0:1789446249.708829:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876369794641280 offset 0 length 520: 4 00000100:00100000:2.0:1789446249.708858:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794641408:0@lo:8:kworker.0 00000400:00000100:2.0:1789446249.708996:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876369794641408 offset 0 length 520: 4 00000100:00080000:3.0:1789446249.709095:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789446249.709099:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789446249.709103:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789446249.709320:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1876369794641792:0@lo:400:kworker.0 00000100:00100000:3.0:1789446249.709359:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446249.709407:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794641792 00000100:00100000:3.0:1789446249.709413:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794641792 00000100:00100000:3.0:1789446249.709446:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789446249.709461:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1876369794641792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446249.709503:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1876369794641792:12345-0@lo:400:kworker.0 Request processed in 43us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446249.709509:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789446249.709537:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c2c07a90e00 x1876369794641792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789446249.709548:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1876369794641792:0@lo:400:kworker.0 00000100:00100000:0.0:1789446249.711469:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794641024 00000100:00100000:0.0:1789446249.711487:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794641024 00000100:00100000:1.0:1789446249.711669:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789446249.711682:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d07223050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+18:3658:x1876369794641024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446249.711787:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d07223050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+18:3658:x1876369794641024:12345-0@lo:400:kworker.0 Request processed in 109us (4223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446249.711796:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789446249.712025:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:282408b2-7484-4ad3-93ba-27093493daa8:3658:1876369794641024:0@lo:400:kworker.0 00000040:00080000:2.0:1789446250.548486:0:23579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789446250.662374:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446251.687605:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446252.710196:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446253.734314:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789446253.798918:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1876369794641920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789446253.799039:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446253.799121:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789446253.799130:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1876369794642048:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789446253.799160:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446253.799193:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794641920 00000100:00100000:1.0:1789446253.799205:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794641920 00000100:00100000:1.0:1789446253.799274:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794642048 00000100:00100000:1.0:1789446253.799278:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794642048 00000100:00100000:1.0:1789446253.799299:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789446253.799309:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1876369794641920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789446253.799354:0:22830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789446253.799443:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1876369794641920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446253.799451:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789446253.799471:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789446253.799477:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876369794642048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789446253.799496:0:22830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789446253.799528:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876369794642048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446253.799534:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789446253.799586:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1876369794641920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789446253.799622:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1876369794642048:0@lo:41:osp-pre-0-1.0 00000020:01000004:1.0:1789446254.067057:0:24325:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789446254.067063:0:24325:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789446254.067065:0:24325:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789446254.067192:0:24325:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c2d31d3f000 00000020:01000004:1.0:1789446254.067212:0:24325:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789446254.067240:0:24325:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789446254.067259:0:24325:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c2c0667cd40) 00000020:00000080:1.0:1789446254.067279:0:24325:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789446254.113405:0:24325:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789446254.117308:0:24325:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789446254.117885:0:24325:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789446254.118311:0:24325:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789446254.118686:0:24325:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789446254.119050:0:24325:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789446254.119335:0:24325:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1789446254.120910:0:24325:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789446254.121377:0:24325:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789446254.121394:0:24325:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789446254.121409:0:24325:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x62554ff374550822 00000020:01000004:3.0:1789446254.121418:0:24325:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789446254.121460:0:24325:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.148@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789446254.121465:0:24325:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789446254.121472:0:24325:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789446254.121478:0:24325:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789446254.121495:0:24325:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c2d3d094d40) 00000020:00000080:3.0:1789446254.121509:0:24325:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1789446254.129375:0:24325:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789446254.129918:0:24325:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789446254.129926:0:24325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789446254.134684:0:24325:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789446254.134707:0:24325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789446254.138503:0:24325:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789446254.138521:0:24325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789446254.144268:0:24325:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789446254.147654:0:24325:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789446254.147669:0:24325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789446254.154132:0:24325:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789446254.154161:0:24325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789446254.209697:0:24325:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789446254.210000:0:24325:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789446254.210006:0:24325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789446254.217086:0:24325:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789446254.217108:0:24325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789446254.225640:0:24325:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789446254.225667:0:24325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789446254.239686:0:24325:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789446254.240273:0:24325:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789446254.240281:0:24325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789446254.241896:0:24325:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789446254.241912:0:24325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789446254.347154:0:24325:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789446254.347894:0:24325:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789446254.347902:0:24325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789446254.350473:0:24325:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789446254.350487:0:24325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789446254.350987:0:24325:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789446254.351016:0:24325:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1789446254.351023:0:24325:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789446254.381882:0:24325:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789446254.381945:0:24325:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.148@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789446254.381949:0:24325:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789446254.381951:0:24325:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789446254.381953:0:24325:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789446254.381954:0:24325:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789446254.382227:0:24325:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789446254.382229:0:24325:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789446254.382231:0:24325:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789446254.382233:0:24325:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789446254.382234:0:24325:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789446254.382238:0:24325:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789446254.382241:0:24325:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789446254.382242:0:24325:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789446254.382244:0:24325:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789446254.382245:0:24325:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789446254.382246:0:24325:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789446254.382255:0:24325:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789446254.382256:0:24325:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789446254.382257:0:24325:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789446254.382258:0:24325:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789446254.382357:0:24325:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789446254.382387:0:24325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794642176:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789446254.382461:0:24325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446254.382506:0:24325:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d207c4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789446254.382702:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794642176 00000100:00100000:0.0:1789446254.382710:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794642176 00000100:00100000:0.0:1789446254.382770:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789446254.382778:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d07220050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+18:24325:x1876369794642176:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789446254.382804:0:22819:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789446254.382807:0:22819:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789446254.382811:0:22819:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789446254.385984:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d07220050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+18:24325:x1876369794642176:12345-0@lo:253:mount.lustre.0 Request processed in 3178us (3494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446254.385997:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789446254.386277:0:24325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794642176:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789446254.386293:0:24325:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789446254.386297:0:24325:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789446254.386299:0:24325:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789446254.386300:0:24325:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789446254.386302:0:24325:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789446254.386303:0:24325:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789446254.386305:0:24325:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789446254.386306:0:24325:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789446254.386308:0:24325:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789446254.386309:0:24325:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789446254.386329:0:24325:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c2d31d3f000 from lustre-OST0000 10000000:01000000:2.0:1789446254.386383:0:24325:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789446254.386386:0:24325:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789446254.386394:0:24325:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c2c069e0000 local copy 00010000:00010000:2.0:1789446254.386404:0:24325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50400/0x62554ff3745505dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745505e4 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446254.386520:0:24325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794642304:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789446254.386556:0:24325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446254.386584:0:24325:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d3d099cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789446254.388698:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794642304 00000100:00100000:1.0:1789446254.388712:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794642304 00000100:00100000:1.0:1789446254.388785:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789446254.388795:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+18:24325:x1876369794642304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789446254.389148:0:24325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794642304:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789446254.389169:0:24325:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789446254.389197:0:24325:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789446254.389205:0:24325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50400/0x62554ff3745505dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745505e4 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446254.389227:0:24325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50400/0x62554ff3745505dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745505e4 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789446254.389257:0:24325:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c2d31d3f000 10000000:01000000:3.0:1789446254.389262:0:24325:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789446254.389268:0:24325:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789446254.389271:0:24325:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789446254.389275:0:24325:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789446254.389278:0:24325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789446254.389307:0:24325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36807400/0x62554ff374550830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446254.389315:0:24325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d36807400/0x62554ff374550830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446254.389340:0:24325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d36807400/0x62554ff374550830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446254.389359:0:24325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794642432:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789446254.390283:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+18:24325:x1876369794642304:12345-0@lo:501:mount.lustre.0 Request processed in 1485us (3721us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789446254.390295:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789446254.390393:0:24325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446254.390457:0:24325:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d04d390c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789446254.390669:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794642432 00000100:00100000:3.0:1789446254.390676:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794642432 00000100:00100000:3.0:1789446254.390718:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789446254.390726:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+18:24325:x1876369794642432:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789446254.390737:0:22819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446254.390751:0:22819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d36807800/0x62554ff374550837 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff374550830 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446254.390774:0:22819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d36807800/0x62554ff374550837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff374550830 expref: 19 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446254.390784:0:22819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d36807800/0x62554ff374550837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff374550830 expref: 19 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446254.390793:0:22819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d36807800, rc 0) 00000100:00100000:3.0:1789446254.390838:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+19:24325:x1876369794642432:12345-0@lo:101:mount.lustre.0 Request processed in 113us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446254.390845:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789446254.391097:0:24325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794642432:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789446254.391113:0:24325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d36807400/0x62554ff374550830 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550837 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.391123:0:24325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d36807400/0x62554ff374550830 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff374550837 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789446254.399309:0:24325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1789446254.400172:0:24325:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789446254.402359:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1789446254.402417:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1789446254.402626:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1789446254.402644:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1789446254.402658:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1789446254.402673:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1789446254.402704:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1789446254.402838:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1789446254.402858:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1789446254.402872:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1789446254.402884:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1789446254.402897:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1789446254.402925:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1789446254.402931:0:24325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1789446254.403062:0:24325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794642560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789446254.403142:0:24325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446254.403245:0:24325:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d089ed240 going to sleep for 11 seconds 00000100:00100000:0.0:1789446254.403289:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794642560 00000100:00100000:0.0:1789446254.403297:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794642560 00000100:00100000:0.0:1789446254.403395:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789446254.403408:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+19:24325:x1876369794642560:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789446254.403616:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+19:24325:x1876369794642560:12345-0@lo:501:mount.lustre.0 Request processed in 209us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446254.403624:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789446254.403696:0:24325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794642560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789446254.403728:0:24325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794642688:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789446254.403765:0:24325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446254.403933:0:24325:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d089ed240 going to sleep for 11 seconds 00000100:00100000:3.0:1789446254.404227:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794642688 00000100:00100000:3.0:1789446254.404233:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794642688 00000100:00100000:3.0:1789446254.404261:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789446254.404268:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+19:24325:x1876369794642688:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789446254.405021:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+19:24325:x1876369794642688:12345-0@lo:503:mount.lustre.0 Request processed in 749us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446254.405036:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789446254.405111:0:24325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794642688:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789446254.406126:0:24325:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789446254.406225:0:24325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794642816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789446254.406292:0:24325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446254.406379:0:24325:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d089ed240 going to sleep for 11 seconds 00000100:00100000:2.0:1789446254.406463:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794642816 00000100:00100000:2.0:1789446254.406470:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794642816 00000100:00100000:3.0:1789446254.408381:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789446254.408404:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+19:24325:x1876369794642816:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789446254.409057:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+19:24325:x1876369794642816:12345-0@lo:502:mount.lustre.0 Request processed in 662us (2762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446254.409066:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789446254.409539:0:24325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794642816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789446254.409768:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1789446254.409800:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1789446254.409813:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1789446254.409826:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1789446254.409839:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1789446254.409852:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1789446254.409863:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1789446254.409892:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1789446254.409909:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1789446254.409922:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1789446254.409935:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1789446254.409947:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1789446254.410254:0:24325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794642944:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789446254.410309:0:24325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446254.410356:0:24325:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d089ed240 going to sleep for 11 seconds 00000100:00100000:3.0:1789446254.410411:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794642944 00000100:00100000:3.0:1789446254.410418:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794642944 00000100:00100000:3.0:1789446254.410533:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789446254.410542:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+19:24325:x1876369794642944:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789446254.410642:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+19:24325:x1876369794642944:12345-0@lo:502:mount.lustre.0 Request processed in 100us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446254.410649:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789446254.410741:0:24325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794642944:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789446254.410789:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1789446254.410799:0:24325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1789446254.412660:0:24343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789446254.412670:0:24343:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789446254.412676:0:24343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789446254.412678:0:24343:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789446254.412690:0:24343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789446254.412705:0:24343:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c2d369899c0) 00000020:00000080:2.0:1789446254.412782:0:24343:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789446254.412790:0:24343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789446254.412855:0:24343:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2d31d3f000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789446254.412863:0:24343:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789446254.412870:0:24343:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x62554ff374550845 00010000:00010000:2.0:1789446254.420778:0:24343:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1789446254.421282:0:24343:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1789446254.425779:0:24343:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1789446254.428589:0:24343:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789446254.428602:0:24343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789446254.428608:0:24343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789446254.428610:0:24343:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789446254.428613:0:24343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789446254.428616:0:24343:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1789446254.428617:0:24343:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789446254.428618:0:24343:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789446254.428620:0:24343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789446254.428622:0:24343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789446254.428624:0:24343:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789446254.428626:0:24343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789446254.428628:0:24343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789446254.428630:0:24343:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789446254.428632:0:24343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789446254.428634:0:24343:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789446254.428636:0:24343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789446254.428638:0:24343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789446254.428640:0:24343:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789446254.428642:0:24343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789446254.428644:0:24343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789446254.428645:0:24343:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789446254.428648:0:24343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789446254.428675:0:24343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789446254.428689:0:24343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789446254.428690:0:24343:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789446254.428694:0:24343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1789446254.429297:0:24325:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789446254.429327:0:24325:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789446254.429352:0:24325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36807400/0x62554ff374550830 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550837 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446254.429364:0:24325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d36807400/0x62554ff374550830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550837 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789446254.429373:0:24325:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c2d31d3f000 from 1 10000000:01000000:3.0:1789446254.429376:0:24325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789446254.429410:0:24325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36807600/0x62554ff37455084c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446254.429418:0:24325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d36807600/0x62554ff37455084c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446254.429449:0:24325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d36807600/0x62554ff37455084c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446254.429472:0:24325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794643072:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789446254.429534:0:24325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446254.429577:0:24325:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d04d39e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789446254.429686:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794643072 00000100:00100000:2.0:1789446254.429694:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794643072 00000100:00100000:2.0:1789446254.429890:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789446254.429901:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+19:24325:x1876369794643072:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789446254.429914:0:22818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789446254.429926:0:22818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d35ea7000/0x62554ff374550853 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff37455084c expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446254.429949:0:22818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d35ea7000/0x62554ff374550853 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff37455084c expref: 20 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446254.429988:0:22818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d35ea7000/0x62554ff374550853 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff37455084c expref: 20 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446254.429996:0:22818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d35ea7000, rc 0) 00000100:00100000:2.0:1789446254.430036:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+20:24325:x1876369794643072:12345-0@lo:101:mount.lustre.0 Request processed in 138us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446254.430043:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789446254.430256:0:24325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794643072:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789446254.430272:0:24325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d36807600/0x62554ff37455084c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550853 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446254.430281:0:24325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d36807600/0x62554ff37455084c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff374550853 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789446254.431518:0:24325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1789446254.431913:0:24325:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789446254.432192:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1789446254.432230:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1789446254.432247:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1789446254.432258:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1789446254.432269:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1789446254.432283:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1789446254.432297:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1789446254.432310:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1789446254.432323:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1789446254.432335:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1789446254.432348:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1789446254.432380:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1789446254.432388:0:24325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1789446254.433137:0:24325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794643200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789446254.433205:0:24325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446254.433294:0:24325:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d04d39c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789446254.437239:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794643200 00000100:00100000:3.0:1789446254.437255:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794643200 00000100:00100000:3.0:1789446254.437321:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789446254.437330:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+20:24325:x1876369794643200:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789446254.437656:0:24325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794643200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789446254.437708:0:24325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794643328:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789446254.441576:0:24325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446254.442571:0:24325:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d089ed3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789446254.442914:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+20:24325:x1876369794643200:12345-0@lo:501:mount.lustre.0 Request processed in 5581us (9704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446254.442935:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789446254.442999:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794643328 00000100:00100000:3.0:1789446254.443006:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794643328 00000100:00100000:2.0:1789446254.446453:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789446254.446475:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+20:24325:x1876369794643328:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789446254.446647:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+20:24325:x1876369794643328:12345-0@lo:503:mount.lustre.0 Request processed in 182us (5075us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446254.446655:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789446254.446824:0:24325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794643328:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789446254.447287:0:24325:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789446254.447367:0:24325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794643456:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789446254.447415:0:24325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446254.447458:0:24325:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d089ed3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789446254.449500:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794643456 00000100:00100000:3.0:1789446254.449515:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794643456 00000100:00100000:3.0:1789446254.449556:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789446254.449566:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+20:24325:x1876369794643456:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789446254.449722:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+20:24325:x1876369794643456:12345-0@lo:502:mount.lustre.0 Request processed in 157us (2305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446254.449784:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789446254.452392:0:24325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794643456:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789446254.452711:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1789446254.452889:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1789446254.452904:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1789446254.452915:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1789446254.453209:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1789446254.453237:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1789446254.453251:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1789446254.453262:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1789446254.453275:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1789446254.453288:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1789446254.453303:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1789446254.453343:0:24325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794643584:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789446254.453415:0:24325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446254.453501:0:24325:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c07892e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789446254.453696:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794643584 00000100:00100000:3.0:1789446254.453703:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794643584 00000100:00100000:3.0:1789446254.453768:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789446254.453778:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+20:24325:x1876369794643584:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789446254.453897:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+20:24325:x1876369794643584:12345-0@lo:502:mount.lustre.0 Request processed in 120us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446254.453904:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789446254.454102:0:24325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794643584:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789446254.454159:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1789446254.454168:0:24325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789446254.456354:0:24347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789446254.456366:0:24347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446254.456368:0:24347:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789446254.456376:0:24347:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c2d31d3f000 00000020:00000080:1.0:1789446254.456379:0:24347:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789446254.456387:0:24347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789446254.456389:0:24347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446254.456391:0:24347:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789446254.456393:0:24347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789446254.456395:0:24347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446254.456396:0:24347:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789446254.456411:0:24347:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c2d31d3f000 00000020:00000080:1.0:1789446254.456413:0:24347:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789446254.456481:0:24347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789446254.456484:0:24347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446254.456486:0:24347:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789446254.456489:0:24347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789446254.456491:0:24347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446254.456492:0:24347:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789446254.456495:0:24347:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c2d31d3f000 00000020:00000080:1.0:1789446254.456498:0:24347:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789446254.456516:0:24347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789446254.456519:0:24347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446254.456520:0:24347:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789446254.456523:0:24347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789446254.456525:0:24347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446254.456526:0:24347:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789446254.456529:0:24347:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c2d31d3f000 00000020:00000080:1.0:1789446254.456531:0:24347:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789446254.456552:0:24347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789446254.456555:0:24347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446254.456556:0:24347:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789446254.456559:0:24347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1789446254.456701:0:24325:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789446254.456746:0:24325:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789446254.456768:0:24325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36807600/0x62554ff37455084c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550853 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.456780:0:24325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d36807600/0x62554ff37455084c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550853 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446254.456829:0:24325:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789446254.456832:0:24325:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c2d31d3f000 10000000:01000000:0.0:1789446254.456835:0:24325:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c2d31d3f000 10000000:01000000:0.0:1789446254.456839:0:24325:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789446254.456844:0:24325:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c2d31d3f000 from 1 10000000:01000000:0.0:1789446254.456847:0:24325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789446254.456880:0:24325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51200/0x62554ff37455085a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.456888:0:24325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51200/0x62554ff37455085a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.456906:0:24325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51200/0x62554ff37455085a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446254.456940:0:24325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794643712:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789446254.457081:0:24325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446254.457151:0:24325:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c07892780 going to sleep for 11 seconds 00000100:00100000:2.0:1789446254.457248:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794643712 00000100:00100000:2.0:1789446254.457255:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794643712 00000100:00100000:2.0:1789446254.457314:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789446254.457331:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+20:24325:x1876369794643712:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789446254.457344:0:22819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789446254.457611:0:22819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d35ea6400/0x62554ff374550861 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff37455085a expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446254.457638:0:22819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d35ea6400/0x62554ff374550861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff37455085a expref: 21 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446254.457649:0:22819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d35ea6400/0x62554ff374550861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff37455085a expref: 21 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446254.457658:0:22819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d35ea6400, rc 0) 00000100:00100000:2.0:1789446254.457713:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+21:24325:x1876369794643712:12345-0@lo:101:mount.lustre.0 Request processed in 384us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446254.457721:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789446254.460401:0:24325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794643712:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789446254.460428:0:24325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51200/0x62554ff37455085a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550861 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446254.460441:0:24325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51200/0x62554ff37455085a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff374550861 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789446254.465743:0:24325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1789446254.466033:0:24325:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789446254.466195:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1789446254.466241:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1789446254.466257:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1789446254.466269:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1789446254.466283:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1789446254.466297:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1789446254.466311:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1789446254.466323:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1789446254.466336:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1789446254.466348:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1789446254.466377:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1789446254.466394:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1789446254.466407:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1789446254.466419:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1789446254.466445:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1789446254.466457:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1789446254.466467:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1789446254.466477:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1789446254.466487:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1789446254.466498:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1789446254.466510:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1789446254.466523:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1789446254.466534:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1789446254.466546:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1789446254.466559:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1789446254.466572:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1789446254.466594:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1789446254.466606:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1789446254.466616:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1789446254.466626:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1789446254.466637:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1789446254.466651:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1789446254.466662:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1789446254.466672:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1789446254.466689:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1789446254.466700:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1789446254.466710:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1789446254.466720:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1789446254.466730:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1789446254.466740:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1789446254.466750:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1789446254.466760:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1789446254.466780:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1789446254.466791:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1789446254.466801:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1789446254.466811:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1789446254.466821:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1789446254.466831:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1789446254.466916:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1789446254.466935:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1789446254.466952:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1789446254.466980:0:24325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1789446254.467052:0:24325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794643840:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789446254.467104:0:24325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446254.467140:0:24325:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d089edc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789446254.467277:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794643840 00000100:00100000:0.0:1789446254.467284:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794643840 00000100:00100000:0.0:1789446254.467334:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789446254.467343:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+21:24325:x1876369794643840:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789446254.467479:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+21:24325:x1876369794643840:12345-0@lo:501:mount.lustre.0 Request processed in 138us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446254.467487:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789446254.473053:0:24325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794643840:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789446254.473118:0:24325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794643968:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789446254.473192:0:24325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446254.473243:0:24325:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d089edc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789446254.473329:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794643968 00000100:00100000:0.0:1789446254.473336:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794643968 00000100:00100000:0.0:1789446254.473388:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789446254.473397:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+21:24325:x1876369794643968:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789446254.474110:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+21:24325:x1876369794643968:12345-0@lo:503:mount.lustre.0 Request processed in 712us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446254.474119:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789446254.474257:0:24325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794643968:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789446254.477386:0:24325:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789446254.477495:0:24325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794644096:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789446254.477571:0:24325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446254.477610:0:24325:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d089edf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789446254.478177:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794644096 00000100:00100000:0.0:1789446254.478185:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794644096 00000100:00100000:0.0:1789446254.478239:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789446254.478248:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+21:24325:x1876369794644096:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789446254.478413:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+21:24325:x1876369794644096:12345-0@lo:502:mount.lustre.0 Request processed in 165us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446254.478426:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789446254.478705:0:24325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794644096:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789446254.478915:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1789446254.478943:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1789446254.478982:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1789446254.479001:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1789446254.479032:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1789446254.479048:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1789446254.479062:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1789446254.479077:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1789446254.479089:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1789446254.479100:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1789446254.479113:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1789446254.479126:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1789446254.479144:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1789446254.479157:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1789446254.479167:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1789446254.479178:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1789446254.479190:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1789446254.479201:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1789446254.479227:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1789446254.479244:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1789446254.479270:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1789446254.479285:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1789446254.479298:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1789446254.479312:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1789446254.479324:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1789446254.479337:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1789446254.479349:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1789446254.479362:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1789446254.479387:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1789446254.479400:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1789446254.479411:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1789446254.479437:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1789446254.479452:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1789446254.479465:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1789446254.479478:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1789446254.479491:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1789446254.479517:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1789446254.479532:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1789446254.479543:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1789446254.479556:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1789446254.479569:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1789446254.479581:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1789446254.479593:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1789446254.479604:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1789446254.479615:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1789446254.479626:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1789446254.479638:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1789446254.479651:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1789446254.479692:0:24325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794644224:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789446254.479745:0:24325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446254.479789:0:24325:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d089edf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789446254.479983:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794644224 00000100:00100000:2.0:1789446254.479989:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794644224 00000100:00100000:2.0:1789446254.480029:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789446254.480036:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+21:24325:x1876369794644224:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789446254.480146:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+21:24325:x1876369794644224:12345-0@lo:502:mount.lustre.0 Request processed in 110us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446254.480153:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789446254.480302:0:24325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794644224:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789446254.480588:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1789446254.480613:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1789446254.480639:0:24325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794644352:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789446254.480678:0:24325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446254.480750:0:24325:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d089edf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789446254.483630:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794644352 00000100:00100000:0.0:1789446254.483645:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794644352 00000100:00100000:0.0:1789446254.484543:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789446254.484559:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+21:24325:x1876369794644352:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789446254.484837:0:24325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794644352:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789446254.484917:0:24325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1789446254.484930:0:24325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000100:00100000:0.0:1789446254.485406:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+21:24325:x1876369794644352:12345-0@lo:502:mount.lustre.0 Request processed in 851us (4726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446254.485417:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:01000004:1.0:1789446254.487608:0:24352:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789446254.487624:0:24352:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c2c066799c0) 00000020:00000080:1.0:1789446254.487647:0:24352:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1789446254.487877:0:24352:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2d31d3f000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789446254.487881:0:24352:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2d31d3f000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789446254.487884:0:24352:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c2d31d3f000 3 00010000:00080000:1.0:1789446254.487913:0:24352:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2c07a6a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.148@tcp at head 00010000:00010000:1.0:1789446254.493294:0:24352:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1789446254.496181:0:24352:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789446254.496265:0:24352:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789446254.496279:0:24352:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x62554ff37455086f 00000100:00080000:1.0:1789446254.496289:0:24352:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789446254.496300:0:24352:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2c07a6a000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1789446254.496336:0:24352:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2c082d0a80 x1876369794644480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789446254.496365:0:24352:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789446254.496412:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789446254.496416:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789446254.496945:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1876369794644480:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789446254.497026:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446254.497076:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789446254.497085:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794644608:0@lo:400:kworker.0 00000100:00100000:3.0:1789446254.497111:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446254.497143:0:22825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794644480 00000100:00100000:3.0:1789446254.497149:0:22825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794644480 00000100:00100000:3.0:1789446254.497177:0:22825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789446254.497184:0:22825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1876369794644480:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789446254.497206:0:22825:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 636 last 0 00000020:00000080:3.0:1789446254.497740:0:22825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x62554ff374550876 00000004:00100000:3.0:1789446254.497756:0:22825:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789446254.497790:0:22825:0:(import.c:65:import_set_state_nolock()) ffff9c2d3fea2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789446254.497847:0:22825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1876369794644480:12345-0@lo:38:llog_process_th.0 Request processed in 661us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446254.497856:0:22825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789446254.497887:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794644608 00000100:00100000:3.0:1789446254.497892:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794644608 00000100:00100000:3.0:1789446254.497983:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789446254.497992:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794644608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446254.498032:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794644608:12345-0@lo:400:kworker.0 Request processed in 42us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446254.498038:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789446254.498078:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794644608:0@lo:400:kworker.0 00010000:00080000:3.0:1789446254.498107:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c2c082d0a80 x1876369794644480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789446264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789446254.498117:0:3656:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789446254.498130:0:3656:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1789446254.498138:0:3656:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789446254.498142:0:3656:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789446254.498144:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2c07a6a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789446254.498151:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1876369794644480:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1789446254.498978:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789446254.498982:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789446254.499027:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789446254.499030:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789446254.499033:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789446254.499042:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789446254.499085:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876369794644992:0@lo:400:kworker.0 00000100:00100000:1.0:1789446254.499098:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794644864:0@lo:400:kworker.0 00000100:00100000:3.0:1789446254.499127:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446254.499127:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446254.499152:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789446254.499157:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1876369794644736:0@lo:400:kworker.0 00000100:00100000:3.0:1789446254.499165:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794644992 00000100:00100000:3.0:1789446254.499170:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794644992 00000100:00100000:1.0:1789446254.499190:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446254.499199:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794644736 00000100:00100000:3.0:1789446254.499201:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794644736 00000100:00100000:1.0:1789446254.499231:0:23565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794644864 00000100:00100000:3.0:1789446254.499233:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789446254.499235:0:23565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794644864 00000100:00100000:3.0:1789446254.499240:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d08191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876369794644992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446254.499256:0:23565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789446254.499262:0:23565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794644864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446254.499279:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d08191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876369794644992:12345-0@lo:400:kworker.0 Request processed in 39us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446254.499286:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789446254.499291:0:23565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794644864:12345-0@lo:400:kworker.0 Request processed in 30us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446254.499297:0:23565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789446254.499325:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794644864:0@lo:400:kworker.0 00000100:00100000:3.0:1789446254.499442:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789446254.499450:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1876369794644736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446254.499494:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1876369794644736:12345-0@lo:400:kworker.0 Request processed in 46us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446254.499589:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789446254.499809:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c2c082d1500 x1876369794644992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789446254.499820:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876369794644992:0@lo:400:kworker.0 00010000:00080000:1.0:1789446254.500614:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c2c082d1880 x1876369794644736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789446254.500627:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1876369794644736:0@lo:400:kworker.0 00000020:01000004:1.0:1789446254.503185:0:24352:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789446254.503202:0:24352:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9c2c0667b380) 00000020:00000080:1.0:1789446254.503867:0:24352:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1789446254.504620:0:24352:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2d31d3f000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789446254.504626:0:24352:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2d31d3f000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789446254.504629:0:24352:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c2d31d3f000 3 00010000:00080000:1.0:1789446254.504666:0:24352:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2c07a6d800@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.148@tcp at head 00010000:00010000:1.0:1789446254.511893:0:24352:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1789446254.513951:0:24352:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789446254.514035:0:24352:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789446254.514048:0:24352:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x62554ff374550884 00000100:00080000:1.0:1789446254.514058:0:24352:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789446254.514070:0:24352:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9c2c07a6d800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1789446254.515138:0:24352:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2c082d1880 x1876369794645120/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789446254.515164:0:24352:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789446254.515188:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789446254.515193:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789446254.515196:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789446254.515199:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789446254.515203:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789446254.515206:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789446254.515208:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789446254.515211:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789446254.515520:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3656:1876369794645120:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789446254.515583:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446254.515611:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794645120 00000100:00100000:3.0:1789446254.515622:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794645120 00000100:00100000:3.0:1789446254.515656:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789446254.515663:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2fa3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1876369794645120:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789446254.515700:0:22826:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 636 last 0 00000020:00000080:3.0:1789446254.515732:0:22826:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x62554ff37455088b 00000004:00100000:3.0:1789446254.515748:0:22826:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789446254.515775:0:22826:0:(import.c:65:import_set_state_nolock()) ffff9c2d3fea4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789446254.515826:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2fa3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1876369794645120:12345-0@lo:38:llog_process_th.0 Request processed in 162us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446254.515833:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789446254.515874:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c2c082d1880 x1876369794645120/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789446264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789446254.515884:0:3656:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789446254.515890:0:3656:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1789446254.515897:0:3656:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789446254.515901:0:3656:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789446254.515903:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2c07a6d800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789446254.515909:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3656:1876369794645120:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789446254.517708:0:24352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1789446254.517851:0:24325:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789446254.517882:0:24325:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789446254.517937:0:24325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51200/0x62554ff37455085a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550861 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446254.517948:0:24325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51200/0x62554ff37455085a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550861 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789446254.518443:0:24325:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789446254.518447:0:24325:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789446254.518449:0:24325:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789446254.518450:0:24325:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789446254.518451:0:24325:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789446254.518452:0:24325:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789446254.518454:0:24325:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789446254.518455:0:24325:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789446254.518456:0:24325:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789446254.518460:0:24325:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789446254.518468:0:24325:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789446254.518469:0:24325:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789446254.518470:0:24325:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789446254.518471:0:24325:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789446254.518472:0:24325:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789446254.518473:0:24325:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789446254.518474:0:24325:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789446254.518475:0:24325:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789446254.518476:0:24325:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789446254.518566:0:24325:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789446254.518586:0:24325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08193b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794645248:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789446254.518644:0:24325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446254.518683:0:24325:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d0880be40 going to sleep for 11 seconds 00000100:00100000:2.0:1789446254.518693:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794645248 00000100:00100000:2.0:1789446254.518700:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794645248 00000100:00100000:2.0:1789446254.518759:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789446254.518767:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+21:24325:x1876369794645248:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789446254.518790:0:22819:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789446254.518803:0:22819:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789446254.522697:0:22819:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789446254.522717:0:22819:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789446254.523030:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+21:24325:x1876369794645248:12345-0@lo:253:mount.lustre.0 Request processed in 4259us (4381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446254.523041:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789446254.523234:0:24325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08193b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:24325:1876369794645248:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789446254.523248:0:24325:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789446254.523251:0:24325:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789446254.523252:0:24325:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789446254.523254:0:24325:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789446254.523255:0:24325:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789446254.523256:0:24325:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789446254.523257:0:24325:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789446254.523259:0:24325:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789446254.523260:0:24325:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789446254.523262:0:24325:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789446254.523278:0:24325:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789446254.523857:0:22840:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789446254.523862:0:22840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789446254.523883:0:22840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2d36a51600/0x62554ff374550892 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.523899:0:22840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2d42054c00/0x62554ff3745507dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff3745507d5 expref: 20 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.523907:0:22840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2d36806800/0x62554ff3745507ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff3745507e3 expref: 20 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.523915:0:22840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c2d36a51600/0x62554ff374550892 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.523953:0:22840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2d36806800/0x62554ff3745507ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x62554ff3745507e3 expref: 20 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.524009:0:22840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2d36806800/0x62554ff3745507ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x62554ff3745507e3 expref: 20 pid: 22818 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446254.524030:0:22840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2fa3c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22840:1876369794645376:0@lo:104: 00000100:00100000:0.0:1789446254.524076:0:22840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789446254.524153:0:22840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2d42054c00/0x62554ff3745507dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x62554ff3745507d5 expref: 20 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.524160:0:22840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2d42054c00/0x62554ff3745507dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x62554ff3745507d5 expref: 20 pid: 22816 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446254.524168:0:22840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d369d7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22840:1876369794645504:0@lo:104: 00000100:00100000:0.0:1789446254.524190:0:22840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446254.524228:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c078923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789446254.524254:0:22807:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789446254.524268:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794645376 00000100:00100000:0.0:1789446254.524273:0:22807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794645376 00000100:00100000:0.0:1789446254.524302:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794645504 00000100:00100000:0.0:1789446254.524306:0:22807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794645504 00000100:00100000:0.0:1789446254.524320:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789446254.524327:0:22807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2fa3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:282408b2-7484-4ad3-93ba-27093493daa8+4:22840:x1876369794645376:12345-0@lo:104: 00010000:00010000:0.0:1789446254.524339:0:22807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff3745507e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff3745507ea expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.524392:0:22807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789446254.524398:0:22807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2fa3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:282408b2-7484-4ad3-93ba-27093493daa8+4:22840:x1876369794645376:12345-0@lo:104: Request processed in 71us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446254.524404:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789446254.524420:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789446254.524426:0:22807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d07223450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:282408b2-7484-4ad3-93ba-27093493daa8+3:22840:x1876369794645504:12345-0@lo:104: 00010000:00010000:0.0:1789446254.524440:0:22807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9c2d42055800/0x62554ff3745507d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff3745507dc expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.527808:0:22807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789446254.527825:0:22807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d07223450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:282408b2-7484-4ad3-93ba-27093493daa8+3:22840:x1876369794645504:12345-0@lo:104: Request processed in 3395us (3629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446254.527837:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789446254.527899:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789446254.527907:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff3745507e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff3745507ea expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.527916:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36807c00 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:0.0:1789446254.527921:0:22813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff3745507e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x62554ff3745507ea expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.527931:0:22813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff3745507e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x62554ff3745507ea expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789446254.527937:0:22813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff3745507e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x62554ff3745507ea expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446254.527942:0:22813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789446254.528167:0:22813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff3745507e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745507ea expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.528174:0:22813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789446254.528205:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff3745507e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745507ea expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.528295:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff3745507e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745507ea expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.528317:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446254.528321:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d42055800/0x62554ff3745507d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff3745507dc expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.528327:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d42055800 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:0.0:1789446254.528329:0:22813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d42055800/0x62554ff3745507d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x62554ff3745507dc expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.528336:0:22813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d42055800/0x62554ff3745507d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x62554ff3745507dc expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789446254.528342:0:22813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d42055800/0x62554ff3745507d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x62554ff3745507dc expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446254.528347:0:22813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789446254.528400:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446254.531001:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d369d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:282408b2-7484-4ad3-93ba-27093493daa8:3660:1876369794645632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789446254.531072:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446254.531146:0:23578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794645632 00000100:00100000:2.0:1789446254.531154:0:23578:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794645632 00010000:00010000:2.0:1789446254.531184:0:23578:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2d36806800/0x62554ff3745507ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff3745507e3 expref: 21 pid: 22818 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446254.531226:0:23578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789446254.531235:0:23578:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:282408b2-7484-4ad3-93ba-27093493daa8+21:3660:x1876369794645632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789446254.531247:0:23578:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789446254.531252:0:23578:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2d36806800/0x62554ff3745507ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff3745507e3 expref: 21 pid: 22818 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446254.531262:0:23578:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2d36806800/0x62554ff3745507ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x62554ff3745507e3 expref: 21 pid: 22818 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446254.531293:0:23578:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789446254.531332:0:23578:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:282408b2-7484-4ad3-93ba-27093493daa8+21:3660:x1876369794645632:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446254.531340:0:23578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789446254.532199:0:22813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9c2d42055800/0x62554ff3745507d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745507dc expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.532208:0:22813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789446254.532241:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d42055800/0x62554ff3745507d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745507dc expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.532248:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d42055800/0x62554ff3745507d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745507dc expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.532264:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446254.532267:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446254.532269:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446254.532286:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d369d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:282408b2-7484-4ad3-93ba-27093493daa8:3657:1876369794645760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789446254.532337:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446254.532411:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794645760 00000100:00100000:0.0:1789446254.532416:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794645760 00010000:00010000:0.0:1789446254.532498:0:22810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2d42054c00/0x62554ff3745507dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff3745507d5 expref: 21 pid: 22816 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446254.532524:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789446254.532532:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c01740450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:282408b2-7484-4ad3-93ba-27093493daa8+21:3657:x1876369794645760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789446254.532541:0:22810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789446254.532545:0:22810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2d42054c00/0x62554ff3745507dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff3745507d5 expref: 21 pid: 22816 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.532555:0:22810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2d42054c00/0x62554ff3745507dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x62554ff3745507d5 expref: 21 pid: 22816 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.532569:0:22810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c2d36a51600/0x62554ff374550892 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.532577:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d36a51600/0x62554ff374550892 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789446254.532594:0:22810:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008732970s 00010000:00010000:0.0:1789446254.532598:0:22810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2d36a51600/0x62554ff374550892 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.532604:0:22810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2d36a51600/0x62554ff374550892 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.532610:0:22810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2d36a51600/0x62554ff374550892 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.532626:0:22810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2d36a51600/0x62554ff374550892 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.532631:0:22810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36a51600 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446254.532635:0:22810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2d36a51600/0x62554ff374550892 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.532642:0:22810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2d36a51600/0x62554ff374550892 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.532651:0:22810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2d36a51600/0x62554ff374550892 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.532661:0:22810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789446254.532701:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c01740450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:282408b2-7484-4ad3-93ba-27093493daa8+21:3657:x1876369794645760:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446254.532708:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789446254.532767:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d369d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:282408b2-7484-4ad3-93ba-27093493daa8:3657:1876369794645760:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789446254.532795:0:22840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d36806800/0x62554ff3745507ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x62554ff3745507e3 expref: 20 pid: 22818 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446254.532804:0:22840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2fa3c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22840:1876369794645376:0@lo:104: 00010000:00010000:0.0:1789446254.532814:0:22840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d42054c00/0x62554ff3745507dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x62554ff3745507d5 expref: 19 pid: 22816 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446254.532822:0:22840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d369d7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22840:1876369794645504:0@lo:104: 00010000:00010000:0.0:1789446254.532836:0:22840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c2d36a51600/0x62554ff374550892 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.532850:0:22840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c2d36a51600/0x62554ff374550892 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.532857:0:22840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2d36a51600/0x62554ff374550892 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446254.532862:0:22840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d36a51600/0x62554ff374550892 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446254.533524:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d369d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:282408b2-7484-4ad3-93ba-27093493daa8:3660:1876369794645632:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1789446254.534566:0:24325:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1789446254.541855:0:24325:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789446254.541864:0:24325:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789446254.541897:0:24325:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789446254.541942:0:24325:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789446254.542001:0:24325:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789446254.542024:0:24325:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1789446254.545814:0:24325:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789446254.546097:0:24325:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789446254.762355:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789446255.459923:0:24406:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789446255.460898:0:24406:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1789446255.670706:0:22821:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789446255.670713:0:22821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c2d3fe3e000 from 13 10000000:01000000:0.0:1789446255.670718:0:22821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789446255.670758:0:22821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51c00/0x62554ff374550899 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446255.670770:0:22821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51c00/0x62554ff374550899 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446255.670781:0:22821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51c00/0x62554ff374550899 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446255.670804:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d369d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794645888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789446255.670868:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446255.670988:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c078923c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789446255.672536:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794645888 00000100:00100000:1.0:1789446255.672547:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794645888 00000100:00100000:1.0:1789446255.672608:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789446255.672618:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+19:22821:x1876369794645888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789446255.672632:0:22816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446255.672650:0:22816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d2fa9dc00/0x62554ff3745508a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff374550899 expref: -99 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446255.672690:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d2fa9dc00/0x62554ff3745508a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff374550899 expref: 20 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446255.672701:0:22816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d2fa9dc00/0x62554ff3745508a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff374550899 expref: 20 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446255.672710:0:22816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d2fa9dc00, rc 0) 00000100:00100000:1.0:1789446255.672773:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+20:22821:x1876369794645888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1904us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446255.672779:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789446255.672910:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d369d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794645888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789446255.672927:0:22821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51c00/0x62554ff374550899 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745508a0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446255.672937:0:22821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51c00/0x62554ff374550899 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff3745508a0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446255.673022:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d369d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794646016:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789446255.673136:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446255.673194:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c078923c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789446255.673259:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794646016 00000100:00100000:2.0:1789446255.673265:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794646016 00000100:00100000:2.0:1789446255.673291:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789446255.673298:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+20:22821:x1876369794646016:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789446255.673312:0:22819:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789446255.673327:0:22819:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789446255.673330:0:22819:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1789446255.673410:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+20:22821:x1876369794646016:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446255.673506:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d369d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794646016:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789446255.673561:0:22821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789446255.673569:0:22821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51c00/0x62554ff374550899 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745508a0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446255.673577:0:22821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51c00/0x62554ff374550899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745508a0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446255.673587:0:22821:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789446255.673590:0:22821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c2d41bbc000 from 13 10000000:01000000:0.0:1789446255.673592:0:22821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789446255.673610:0:22821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51800/0x62554ff3745508a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446255.673618:0:22821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51800/0x62554ff3745508a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446255.673625:0:22821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51800/0x62554ff3745508a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446255.673644:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d369d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794646144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789446255.673669:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446255.673696:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d18292000 going to sleep for 11 seconds 00000100:00100000:0.0:1789446255.673708:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794646144 00000100:00100000:0.0:1789446255.673711:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794646144 00000100:00100000:0.0:1789446255.673728:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789446255.673734:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+21:22821:x1876369794646144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789446255.673742:0:22818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789446255.673752:0:22818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d36a50a00/0x62554ff3745508ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff3745508a7 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446255.673768:0:22818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d36a50a00/0x62554ff3745508ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff3745508a7 expref: 22 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446255.673776:0:22818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d36a50a00/0x62554ff3745508ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff3745508a7 expref: 22 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446255.673783:0:22818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d36a50a00, rc 0) 00000100:00100000:0.0:1789446255.673816:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+22:22821:x1876369794646144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446255.673822:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789446255.673856:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d369d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794646144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789446255.673867:0:22821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51800/0x62554ff3745508a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745508ae expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446255.673874:0:22821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51800/0x62554ff3745508a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff3745508ae expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446255.673912:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d369d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794646272:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789446255.673941:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446255.673979:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d18292000 going to sleep for 11 seconds 00000100:00100000:0.0:1789446255.673989:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794646272 00000100:00100000:0.0:1789446255.673992:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794646272 00000100:00100000:0.0:1789446255.674009:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789446255.674014:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+22:22821:x1876369794646272:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789446255.674024:0:22818:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 00000100:00100000:2.0:1789446255.675139:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 20000000:01000000:0.0:1789446255.676548:0:22818:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789446255.676556:0:22818:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1789446255.676726:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+21:22821:x1876369794646272:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 2709us (2780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446255.676737:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789446255.676790:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d369d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794646272:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789446255.676854:0:22821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789446255.676864:0:22821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51800/0x62554ff3745508a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745508ae expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446255.676874:0:22821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51800/0x62554ff3745508a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745508ae expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446255.785583:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789446256.104304:0:22862:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789446256.806304:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446257.830146:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446258.854755:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789446258.918492:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794646400:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789446258.918552:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446258.918606:0:22829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794646400 00000100:00100000:1.0:1789446258.918614:0:22829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794646400 00000100:00100000:1.0:1789446258.918648:0:22829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789446258.918655:0:22829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794646400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789446258.918684:0:22829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789446258.918733:0:22829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794646400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446258.918740:0:22829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789446258.918788:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794646400:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789446258.919324:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d369d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794646528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789446258.919358:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446258.919431:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794646528 00000100:00100000:0.0:1789446258.919436:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794646528 00000100:00100000:0.0:1789446258.919472:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789446258.919478:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d369d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794646528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789446258.919498:0:22830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789446258.919545:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d369d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794646528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446258.919552:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789446258.919582:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d369d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794646528:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789446259.878616:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789446259.943107:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789446259.943126:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789446259.943128:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789446259.943131:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789446259.943337:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789446259.943340:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789446259.943342:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789446259.943345:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789446259.943379:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d369d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794647040:0@lo:400:kworker.0 00000100:00100000:0.0:1789446259.943442:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446259.943516:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789446259.943522:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d369d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:282408b2-7484-4ad3-93ba-27093493daa8:3659:1876369794646656:0@lo:400:kworker.0 00000100:00100000:0.0:1789446259.943549:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446259.943582:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d369d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876369794647168:0@lo:400:kworker.0 00000100:00100000:0.0:1789446259.943605:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446259.943638:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d369d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1876369794646784:0@lo:400:kworker.0 00000100:00100000:0.0:1789446259.943677:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446259.943702:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d369d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1876369794647296:0@lo:400:kworker.0 00000100:00100000:0.0:1789446259.943727:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446259.943751:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789446259.943758:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d369d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1876369794646912:0@lo:400:kworker.0 00000100:00100000:0.0:1789446259.943779:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446259.943801:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d369d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1876369794647424:0@lo:400:kworker.0 00000100:00100000:0.0:1789446259.943820:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446259.943849:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794646656 00000100:00100000:0.0:1789446259.943856:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794646656 00000100:00100000:0.0:1789446259.943898:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789446259.943906:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+21:3659:x1876369794646656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446259.943986:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+21:3659:x1876369794646656:12345-0@lo:400:kworker.0 Request processed in 80us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446259.943993:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789446259.944028:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794647168 00000100:00100000:0.0:1789446259.944031:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794647168 00000100:00100000:0.0:1789446259.944048:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794647296 00000100:00100000:0.0:1789446259.944051:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794647296 00000100:00100000:0.0:1789446259.944072:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794646912 00000100:00100000:0.0:1789446259.944075:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794646912 00000100:00100000:0.0:1789446259.944084:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794647424 00000100:00100000:0.0:1789446259.944087:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794647424 00000100:00100000:0.0:1789446259.944101:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789446259.944106:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d369d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876369794647168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446259.944252:0:23565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794647040 00000100:00100000:2.0:1789446259.944256:0:23565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794647040 00000100:00100000:2.0:1789446259.944278:0:23565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794646784 00000100:00100000:2.0:1789446259.944280:0:23565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794646784 00000100:00100000:2.0:1789446259.944290:0:23565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789446259.944296:0:23565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d369d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794647040:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789446259.944449:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789446259.944453:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789446259.944474:0:22829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789446259.944481:0:22829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d369d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1876369794646784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446259.944655:0:23565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d369d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794647040:12345-0@lo:400:kworker.0 Request processed in 358us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446259.944661:0:23565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789446259.949306:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d369d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1876369794646784:0@lo:400:kworker.0 00000100:00100000:3.0:1789446259.949438:0:22829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d369d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1876369794646784:12345-0@lo:400:kworker.0 Request processed in 4644us (5447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446259.949457:0:22829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789446259.951862:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d369d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876369794647168:12345-0@lo:400:kworker.0 Request processed in 7746us (8246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446259.951893:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789446259.951930:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789446259.951942:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d369d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1876369794647296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446259.952050:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d369d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1876369794647296:12345-0@lo:400:kworker.0 Request processed in 113us (8322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446259.952057:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789446259.952071:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789446259.952078:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d369d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1876369794646912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446259.952110:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d369d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1876369794646912:12345-0@lo:400:kworker.0 Request processed in 33us (8330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446259.952129:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789446259.952287:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2d369d5c00 x1876369794646912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446259.952302:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d369d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1876369794646912:0@lo:400:kworker.0 00010000:00080000:2.0:1789446259.952318:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2d369d5880 x1876369794647296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446259.952340:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d369d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1876369794647296:0@lo:400:kworker.0 00000100:00100000:0.0:1789446259.952457:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789446259.952465:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d369d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1876369794647424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446259.952520:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d369d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1876369794647424:12345-0@lo:400:kworker.0 Request processed in 56us (8699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446259.952527:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789446259.952575:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d369d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:282408b2-7484-4ad3-93ba-27093493daa8:3659:1876369794646656:0@lo:400:kworker.0 00010000:00080000:0.0:1789446259.952587:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2d369d6d80 x1876369794647168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446259.952597:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d369d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876369794647168:0@lo:400:kworker.0 00000100:00100000:0.0:1789446259.952608:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d369d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794647040:0@lo:400:kworker.0 00010000:00080000:2.0:1789446259.955030:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2d369d4000 x1876369794647424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446259.955047:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d369d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1876369794647424:0@lo:400:kworker.0 00000040:00080000:3.0:1789446260.777329:0:23579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789446260.904406:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789446261.054236:0:24696:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789446261.927520:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789446262.027503:0:24749:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789446262.030270:0:24749:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1789446262.910556:0:24799:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789446262.910772:0:24799:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789446262.951581:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789446263.721116:0:3656:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789446248/real 1789446248] req@ffff9c2c07a90a80 x1876369794640768/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789446263 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789446263.721158:0:3656:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c2c07a90a80 x1876369794640768/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789446263 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789446263.721177:0:3656:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789446248/real 1789446248] req@ffff9c2c07a90380 x1876369794640896/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789446263 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789446263.721191:0:3656:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c2c07a90380 x1876369794640896/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789446263 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789446263.721210:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d31d3c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789446263.721232:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789446263.721237:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794640768:0@lo:8:kworker.0 00000100:00080000:1.0:1789446263.721243:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d3fea6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789446263.721257:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789446263.721259:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794640896:0@lo:8:kworker.0 00000100:00080000:2.0:1789446263.721491:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789446263.721496:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789446263.721499:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789446263.721501:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789446263.721525:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789446263.721528:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789446263.721531:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c2d31d3c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789446263.721535:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 630 00000100:00080000:2.0:1789446263.721540:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789446263.721559:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c2d31d3c000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1789446263.721576:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2d41b7ca80 x1876369794648064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789446263.721610:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789446263.721613:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789446263.721615:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c2d3fea6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789446263.721618:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 630 00000100:00080000:2.0:1789446263.721621:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789446263.721626:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c2d3fea6800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1789446263.721640:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2d41b7f800 x1876369794648192/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789446263.721679:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1876369794647808:0@lo:400:kworker.0 00000100:00100000:2.0:1789446263.721734:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446263.721778:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1876369794648576:0@lo:400:kworker.0 00000100:00100000:2.0:1789446263.721801:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446263.721827:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789446263.721833:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794647936:0@lo:400:kworker.0 00000100:00100000:2.0:1789446263.721858:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446263.721891:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794647808 00000100:00100000:2.0:1789446263.721898:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794647808 00000100:00100000:2.0:1789446263.721934:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794648576 00000100:00100000:2.0:1789446263.721937:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794648576 00000100:00100000:2.0:1789446263.721984:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789446263.721993:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1876369794647808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446263.722041:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1876369794647808:12345-0@lo:400:kworker.0 Request processed in 48us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446263.722048:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789446263.722066:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789446263.722080:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1876369794648576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446263.722109:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1876369794648576:12345-0@lo:400:kworker.0 Request processed in 29us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446263.722114:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789446263.722134:0:23565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794647936 00000100:00100000:2.0:1789446263.722137:0:23565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794647936 00000100:00100000:2.0:1789446263.722160:0:23565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789446263.722167:0:23565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794647936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446263.722209:0:23565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794647936:12345-0@lo:400:kworker.0 Request processed in 42us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446263.722215:0:23565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1789446263.722234:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789446263.722272:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794647936:0@lo:400:kworker.0 00010000:00080000:2.0:1789446263.722283:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2d41b7ea00 x1876369794647808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446263.722291:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1876369794647808:0@lo:400:kworker.0 00010000:00080000:2.0:1789446263.722298:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2d41b7c000 x1876369794648576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446263.722306:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1876369794648576:0@lo:400:kworker.0 00000100:00100000:0.0:1789446263.722629:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:282408b2-7484-4ad3-93ba-27093493daa8:3659:1876369794647552:0@lo:400:kworker.0 00000100:00100000:0.0:1789446263.722666:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446263.722733:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876369794648320:0@lo:400:kworker.0 00000100:00100000:0.0:1789446263.722757:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446263.722780:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789446263.722786:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794647680:0@lo:400:kworker.0 00000100:00100000:0.0:1789446263.722808:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446263.722833:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1876369794648448:0@lo:400:kworker.0 00000100:00100000:0.0:1789446263.722852:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446263.722881:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794647680 00000100:00100000:0.0:1789446263.722886:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794647680 00000100:00100000:0.0:1789446263.722911:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789446263.722917:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d369d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794647680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446263.722984:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d369d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794647680:12345-0@lo:400:kworker.0 Request processed in 66us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446263.722989:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789446263.723017:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794647680:0@lo:400:kworker.0 00000100:00100000:1.0:1789446263.723141:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794648064:0@lo:8:kworker.0 00000100:00100000:1.0:1789446263.723188:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446263.723216:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794648192:0@lo:8:kworker.0 00000100:00100000:1.0:1789446263.723240:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446263.723394:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794647552 00000100:00100000:2.0:1789446263.723399:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794647552 00000100:00100000:2.0:1789446263.723440:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789446263.723448:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+21:3659:x1876369794647552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446263.723491:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+21:3659:x1876369794647552:12345-0@lo:400:kworker.0 Request processed in 43us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446263.723510:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789446263.723556:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794648320 00000100:00100000:2.0:1789446263.723560:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794648320 00000100:00100000:2.0:1789446263.723594:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794648448 00000100:00100000:2.0:1789446263.723597:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794648448 00000100:00100000:2.0:1789446263.723623:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789446263.723630:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d369d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876369794648320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446263.723664:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d369d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876369794648320:12345-0@lo:400:kworker.0 Request processed in 35us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446263.723670:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789446263.723682:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789446263.723688:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d369d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876369794648448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446263.723716:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d369d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876369794648448:12345-0@lo:400:kworker.0 Request processed in 28us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446263.723721:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789446263.723739:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789446263.723786:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2d41b7c700 x1876369794648448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446263.723797:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1876369794648448:0@lo:400:kworker.0 00000100:00100000:2.0:1789446263.723805:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:282408b2-7484-4ad3-93ba-27093493daa8:3659:1876369794647552:0@lo:400:kworker.0 00010000:00080000:2.0:1789446263.723819:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2d41b7e680 x1876369794648320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446263.723827:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876369794648320:0@lo:400:kworker.0 00000100:00100000:0.0:1789446263.727383:0:24330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794648064 00000100:00100000:0.0:1789446263.727398:0:24330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794648064 00000100:00100000:0.0:1789446263.727440:0:24330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794648192 00000100:00100000:0.0:1789446263.727443:0:24330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794648192 00000100:00100000:0.0:1789446263.727458:0:24330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789446263.727467:0:24330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3656:x1876369794648064:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789446263.727498:0:24330:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 645 last 0 00000020:00000080:0.0:1789446263.727530:0:24330:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x62554ff3745508b5 00002000:00100000:0.0:1789446263.727555:0:24330:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9c2d41bb9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1789446263.727571:0:24330:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1789446263.727575:0:24330:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789446263.727748:0:24330:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1789446263.727772:0:24330:0:(import.c:65:import_set_state_nolock()) ffff9c2d205fa800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789446263.727889:0:24330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3656:x1876369794648064:12345-0@lo:8:kworker.0 Request processed in 421us (4699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446263.727897:0:24330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789446263.727911:0:24330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789446263.727916:0:24330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3656:x1876369794648192:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789446263.727928:0:24330:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1789446263.729905:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2d41b7ca80 x1876369794648064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789446283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446263.729927:0:3656:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789446263.729936:0:3656:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1789446263.729945:0:3656:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789446263.729951:0:3656:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789446263.729969:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d31d3c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789446263.729982:0:3656:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789446263.729988:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794648064:0@lo:8:kworker.0 00000004:00080000:1.0:1789446263.730127:0:23567:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789446263.730151:0:23567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23567:1876369794648832:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1789446263.730217:0:23567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446263.730243:0:23567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c07892840 going to sleep for 11 seconds 00000004:00080000:1.0:1789446263.730259:0:23566:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789446263.730344:0:23566:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 645804386679ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789446263.730352:0:23566:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1789446263.730515:0:24332:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789446263.730522:0:24332:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789446263.730663:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789446263.730676:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794648704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789446263.730707:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446263.731045:0:24332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794648832 00000100:00100000:1.0:1789446263.731052:0:24332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794648832 00000100:00100000:1.0:1789446263.731159:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789446263.731183:0:24833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23567:x1876369794648832:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:2.0:1789446263.731427:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789446263.739070:0:24333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794648704 00000100:00100000:3.0:1789446263.739083:0:24333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794648704 00000100:00100000:3.0:1789446263.739133:0:24333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789446263.739143:0:24333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3657:x1876369794648704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789446263.739183:0:24333:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789446263.739265:0:24333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3657:x1876369794648704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (8556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446263.739272:0:24333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789446263.739323:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2c082d1880 x1876369794648704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789446279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789446263.739343:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794648704:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1789446263.743603:0:23557:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:3.0:1789446263.744325:0:24833:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1789446263.744333:0:24833:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1789446263.744431:0:24833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23567:x1876369794648832:12345-0@lo:7:osp-pre-0-1.0 Request processed in 13260us (14210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446263.744446:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789446263.749119:0:24330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3656:x1876369794648192:12345-0@lo:8:kworker.0 Request processed in 21192us (25868us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789446263.749134:0:24330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789446263.749240:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d3fea6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789446263.749246:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789446263.749250:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794648192:0@lo:8:kworker.0 00010000:00080000:2.0:1789446263.750644:0:23567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2c082d1500 x1876369794648832/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789446279 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446263.750659:0:23567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23567:1876369794648832:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789446263.750673:0:23567:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:2.0:1789446263.750716:0:23567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a79f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23567:1876369794648960:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789446263.750762:0:23567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446263.750792:0:23567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d35d856c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789446263.754893:0:24332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794648960 00000100:00100000:0.0:1789446263.754907:0:24332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794648960 00000100:00100000:0.0:1789446263.755883:0:24332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789446263.755897:0:24332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23567:x1876369794648960:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789446263.755929:0:24332:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1789446263.756067:0:24332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23567:x1876369794648960:12345-0@lo:5:osp-pre-0-1.0 Request processed in 173us (5304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446263.756074:0:24332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789446263.756937:0:23567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2c05a79f80 x1876369794648960/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789446279 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446263.756953:0:23567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a79f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23567:1876369794648960:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789446263.757002:0:23567:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1789446263.757397:0:23567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a79f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23567:1876369794649088:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789446263.757440:0:23567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446263.757468:0:23567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d35d856c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789446263.757628:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794649088 00000100:00100000:0.0:1789446263.757635:0:24833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794649088 00000100:00100000:0.0:1789446263.757682:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789446263.757692:0:24833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23567:x1876369794649088:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789446263.757727:0:24833:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:1.0:1789446263.807436:0:24326:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1789446263.807450:0:24326:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789446263.807707:0:24833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23567:x1876369794649088:12345-0@lo:5:osp-pre-0-1.0 Request processed in 50012us (50261us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1789446263.807730:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789446263.807904:0:23567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2c05a79f80 x1876369794649088/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789446279 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446263.807917:0:23567:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1789446263.807923:0:23567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a79f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23567:1876369794649088:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789446263.807938:0:23567:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:2.0:1789446263.808004:0:23567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a79f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23567:1876369794649216:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789446263.808035:0:23567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446263.808059:0:23567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d35d856c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789446263.808341:0:22836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794649216 00000100:00100000:1.0:1789446263.808347:0:22836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794649216 00000100:00100000:1.0:1789446263.808608:0:22836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789446263.808618:0:22836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23567:x1876369794649216:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789446263.808850:0:22836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23567:x1876369794649216:12345-0@lo:900:osp-pre-0-1.0 Request processed in 234us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446263.808857:0:22836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789446263.808933:0:23567:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2c05a79f80 x1876369794649216/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789446279 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446263.808945:0:23567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a79f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23567:1876369794649216:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1789446263.979013:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446264.039288:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789446264.039310:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1876369794649344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789446264.039371:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446264.039427:0:22829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794649344 00000100:00100000:2.0:1789446264.039434:0:22829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794649344 00000100:00100000:2.0:1789446264.039479:0:22829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789446264.039488:0:22829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1876369794649344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789446264.039519:0:22829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789446264.039564:0:22829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1876369794649344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446264.039571:0:22829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789446264.039618:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1876369794649344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789446264.040014:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789446264.040023:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794649472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789446264.040053:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446264.040081:0:23565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794649472 00000100:00100000:2.0:1789446264.040085:0:23565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794649472 00000100:00100000:2.0:1789446264.040116:0:23565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789446264.040122:0:23565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794649472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789446264.040143:0:23565:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789446264.040192:0:23565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794649472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446264.040198:0:23565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789446264.040228:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794649472:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789446264.998150:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446266.040171:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789446266.344332:0:22862:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789446267.051082:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446268.070190:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446269.094898:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789446269.158312:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789446269.158333:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d369d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794649600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789446269.158405:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446269.158610:0:24333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794649600 00000100:00100000:0.0:1789446269.158618:0:24333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794649600 00000100:00100000:0.0:1789446269.158678:0:24333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789446269.158687:0:24333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794649600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789446269.158712:0:24333:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789446269.158789:0:24333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794649600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446269.158797:0:24333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789446269.158836:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2d369d4e00 x1876369794649600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789446285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446269.158854:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d369d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794649600:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789446269.158937:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789446269.160480:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d369d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794649856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789446269.160584:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789446269.160603:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794649728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789446269.161951:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789446269.162273:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789446269.162278:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789446269.162280:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789446269.162283:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789446269.162297:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789446269.162300:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789446269.162303:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c2d3fea6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789446269.162309:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 645 00000100:00080000:3.0:1789446269.162314:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789446269.162322:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c2d3fea6800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789446269.162341:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2d08190e00 x1876369794650496/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789446269.162498:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794650368:0@lo:400:kworker.0 00000100:00100000:0.0:1789446269.162531:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446269.162558:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789446269.162564:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:282408b2-7484-4ad3-93ba-27093493daa8:3659:1876369794649984:0@lo:400:kworker.0 00000100:00100000:0.0:1789446269.162589:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446269.162632:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794649856 00000100:00100000:0.0:1789446269.162639:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794649856 00000100:00100000:0.0:1789446269.162696:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794650368 00000100:00100000:0.0:1789446269.162700:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794650368 00000100:00100000:0.0:1789446269.162730:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789446269.162737:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d369d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794649856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789446269.162766:0:22830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789446269.162815:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d369d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794649856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446269.162821:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789446269.162836:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789446269.162841:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d369d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794650368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446269.162873:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d369d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794650368:12345-0@lo:400:kworker.0 Request processed in 31us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446269.162879:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789446269.162900:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794649984 00000100:00100000:0.0:1789446269.162904:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794649984 00000100:00100000:0.0:1789446269.162929:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789446269.162934:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+21:3659:x1876369794649984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446269.162985:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+21:3659:x1876369794649984:12345-0@lo:400:kworker.0 Request processed in 51us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446269.162991:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789446269.163022:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1876369794650240:0@lo:400:kworker.0 00000100:00100000:0.0:1789446269.163047:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446269.163074:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789446269.163079:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1876369794650112:0@lo:400:kworker.0 00000100:00100000:0.0:1789446269.163098:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446269.163152:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794650240 00000100:00100000:0.0:1789446269.163156:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794650240 00000100:00100000:0.0:1789446269.163190:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789446269.163195:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d369d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1876369794650240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446269.163234:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d369d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1876369794650240:12345-0@lo:400:kworker.0 Request processed in 39us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446269.163240:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789446269.163258:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794650112 00000100:00100000:0.0:1789446269.163261:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794650112 00000100:00100000:0.0:1789446269.163279:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789446269.163283:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d369d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1876369794650112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446269.163317:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d369d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1876369794650112:12345-0@lo:400:kworker.0 Request processed in 34us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446269.163323:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789446269.163495:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794650496:0@lo:8:kworker.0 00000100:00100000:3.0:1789446269.163523:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446269.163555:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446269.163590:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1876369794650752:0@lo:400:kworker.0 00000100:00100000:3.0:1789446269.163611:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446269.163628:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789446269.163633:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1876369794650880:0@lo:400:kworker.0 00000100:00100000:3.0:1789446269.163651:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446269.163899:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794650752 00000100:00100000:3.0:1789446269.163905:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794650752 00000100:00100000:0.0:1789446269.163939:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1876369794650112:0@lo:400:kworker.0 00010000:00080000:0.0:1789446269.163981:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2d08190000 x1876369794650240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446269.163992:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1876369794650240:0@lo:400:kworker.0 00000100:00100000:0.0:1789446269.164015:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1876369794650624:0@lo:400:kworker.0 00000100:00100000:0.0:1789446269.164037:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446269.164072:0:24332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794650496 00000100:00100000:0.0:1789446269.164076:0:24332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794650496 00000100:00100000:0.0:1789446269.164099:0:24332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789446269.164104:0:24332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d08191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3656:x1876369794650496:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789446269.164121:0:24332:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789446269.164172:0:24332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d08191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3656:x1876369794650496:12345-0@lo:8:kworker.0 Request processed in 66us (647us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789446269.164186:0:24332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789446269.164215:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d3fea6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789446269.164220:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789446269.164223:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794650496:0@lo:8:kworker.0 00000100:00100000:0.0:1789446269.164240:0:22829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794649728 00000100:00100000:0.0:1789446269.164243:0:22829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794649728 00000100:00100000:0.0:1789446269.164263:0:22829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789446269.164268:0:22829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d08191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794649728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789446269.164286:0:22829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789446269.164327:0:22829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d08191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794649728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446269.164332:0:22829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789446269.164345:0:22825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794650880 00000100:00100000:0.0:1789446269.164348:0:22825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794650880 00000100:00100000:0.0:1789446269.173307:0:22825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794650624 00000100:00100000:0.0:1789446269.173318:0:22825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794650624 00000100:00100000:0.0:1789446269.173340:0:22825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789446269.173350:0:22825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d08191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1876369794650880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446269.173462:0:22825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d08191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1876369794650880:12345-0@lo:400:kworker.0 Request processed in 114us (9809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446269.173470:0:22825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789446269.173487:0:22825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789446269.173493:0:22825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d369d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1876369794650624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446269.173535:0:22825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d369d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1876369794650624:12345-0@lo:400:kworker.0 Request processed in 43us (9497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446269.173541:0:22825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1789446269.173591:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2d08190700 x1876369794650624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446269.173607:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1876369794650624:0@lo:400:kworker.0 00010000:00080000:0.0:1789446269.173640:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2d08192a00 x1876369794650880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446269.173649:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1876369794650880:0@lo:400:kworker.0 00000100:00100000:0.0:1789446269.173668:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794649728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789446269.173729:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:282408b2-7484-4ad3-93ba-27093493daa8:3659:1876369794649984:0@lo:400:kworker.0 00000100:00100000:0.0:1789446269.173738:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794650368:0@lo:400:kworker.0 00000100:00100000:0.0:1789446269.173751:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d369d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794649856:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1789446269.179679:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789446269.179687:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789446269.179878:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789446269.179894:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d08193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1876369794650752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446269.180001:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d08193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1876369794650752:12345-0@lo:400:kworker.0 Request processed in 114us (16388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446269.180008:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1789446269.180091:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2d08191180 x1876369794650752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789446269.180108:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1876369794650752:0@lo:400:kworker.0 00010000:00010000:2.0:1789446270.118383:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446270.182460:0:3656:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789446249/real 1789446249] req@ffff9c2c07a90000 x1876369794641280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789446269 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446270.182489:0:3656:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c2c07a90000 x1876369794641280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789446269 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446270.182499:0:3656:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789446249/real 1789446249] req@ffff9c2c07a93100 x1876369794641408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789446269 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446270.182509:0:3656:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c2c07a93100 x1876369794641408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789446269 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789446270.182527:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2c05b60800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789446270.182543:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789446270.182547:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794641280:0@lo:8:kworker.0 00000100:00080000:0.0:1789446270.182564:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d187ae000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789446270.182570:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789446270.182573:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794641408:0@lo:8:kworker.0 00000100:00080000:0.0:1789446270.182668:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789446270.182671:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789446270.182674:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c2c05b60800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789446270.182678:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 631 00000100:00080000:0.0:1789446270.182682:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789446270.182691:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c2c05b60800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789446270.182708:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2d369d7800 x1876369794651264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789446270.182721:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789446270.182724:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789446270.182725:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c2d187ae000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789446270.182728:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 631 00000100:00080000:0.0:1789446270.182731:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789446270.182735:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c2d187ae000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789446270.182745:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2c07a93100 x1876369794651392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789446270.182776:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789446270.182780:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789446270.182781:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c2d3fea6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789446270.182784:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 651 00000100:00080000:0.0:1789446270.182787:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789446270.182797:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c2d3fea6800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789446270.182809:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2c07a93800 x1876369794651904/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789446270.182847:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d369d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:282408b2-7484-4ad3-93ba-27093493daa8:3659:1876369794651008:0@lo:400:kworker.0 00000100:00100000:0.0:1789446270.182901:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446270.183002:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794651776:0@lo:400:kworker.0 00000100:00100000:0.0:1789446270.183029:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446270.183055:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789446270.183061:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d369d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794651136:0@lo:400:kworker.0 00000100:00100000:0.0:1789446270.183082:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446270.183104:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876369794652032:0@lo:400:kworker.0 00000100:00100000:0.0:1789446270.183124:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446270.183168:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1876369794651520:0@lo:400:kworker.0 00000100:00100000:0.0:1789446270.183191:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446270.183215:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1876369794652160:0@lo:400:kworker.0 00000100:00100000:0.0:1789446270.183233:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446270.183257:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789446270.183262:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794651648:0@lo:400:kworker.0 00000100:00100000:0.0:1789446270.183283:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446270.183304:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1876369794652288:0@lo:400:kworker.0 00000100:00100000:0.0:1789446270.183324:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446270.183353:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794651008 00000100:00100000:0.0:1789446270.183359:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794651008 00000100:00100000:0.0:1789446270.183400:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789446270.183408:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+21:3659:x1876369794651008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446270.183464:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+21:3659:x1876369794651008:12345-0@lo:400:kworker.0 Request processed in 56us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446270.183471:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789446270.183502:0:23565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794651136 00000100:00100000:0.0:1789446270.183505:0:23565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794651136 00000100:00100000:0.0:1789446270.183531:0:23565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794651648 00000100:00100000:0.0:1789446270.183534:0:23565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794651648 00000100:00100000:0.0:1789446270.183548:0:23565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789446270.183553:0:23565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2fa3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794651136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446270.183592:0:23565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2fa3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794651136:12345-0@lo:400:kworker.0 Request processed in 38us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446270.183598:0:23565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789446270.183609:0:23565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789446270.183614:0:23565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794651648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446270.183665:0:23565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794651648:12345-0@lo:400:kworker.0 Request processed in 36us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446270.183672:0:23565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789446270.183690:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794652032 00000100:00100000:0.0:1789446270.183694:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794652032 00000100:00100000:0.0:1789446270.183711:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794651520 00000100:00100000:0.0:1789446270.183714:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794651520 00000100:00100000:0.0:1789446270.183724:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794652160 00000100:00100000:0.0:1789446270.183726:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794652160 00000100:00100000:0.0:1789446270.183737:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794652288 00000100:00100000:0.0:1789446270.183739:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794652288 00000100:00100000:0.0:1789446270.183751:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789446270.183757:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2fa3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876369794652032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446270.183794:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2fa3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876369794652032:12345-0@lo:400:kworker.0 Request processed in 37us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446270.183808:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789446270.183821:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789446270.183826:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2fa3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1876369794651520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446270.183860:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2fa3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1876369794651520:12345-0@lo:400:kworker.0 Request processed in 34us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446270.183866:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789446270.183877:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789446270.183882:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2fa3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1876369794652160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446270.183915:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2fa3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1876369794652160:12345-0@lo:400:kworker.0 Request processed in 33us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446270.183920:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789446270.183932:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789446270.183937:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1876369794652288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446270.183991:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1876369794652288:12345-0@lo:400:kworker.0 Request processed in 54us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446270.183997:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789446270.184160:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d369d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794651264:0@lo:8:kworker.0 00000100:00100000:0.0:1789446270.184191:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446270.184218:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794651392:0@lo:8:kworker.0 00000100:00100000:0.0:1789446270.184253:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446270.184276:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794651904:0@lo:8:kworker.0 00000100:00100000:0.0:1789446270.184310:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446270.184345:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794651776 00000100:00100000:0.0:1789446270.184350:0:24833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794651776 00000100:00100000:0.0:1789446270.184377:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794651264 00000100:00100000:0.0:1789446270.184380:0:24833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794651264 00000100:00100000:0.0:1789446270.184388:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794651392 00000100:00100000:0.0:1789446270.184390:0:24833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794651392 00000100:00100000:0.0:1789446270.184396:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794651904 00000100:00100000:0.0:1789446270.184398:0:24833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794651904 00000100:00100000:0.0:1789446270.184406:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789446270.184412:0:24833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794651776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446270.184452:0:24833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794651776:12345-0@lo:400:kworker.0 Request processed in 40us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446270.184458:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789446270.184469:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789446270.184473:0:24833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3656:x1876369794651264:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789446270.184495:0:24833:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 652 last 0 00000020:00000080:0.0:1789446270.184521:0:24833:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x62554ff3745508bc 00002000:00100000:0.0:1789446270.184533:0:24833:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c2d37c0f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789446270.184537:0:24833:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789446270.184540:0:24833:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789446270.184608:0:24833:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789446270.184630:0:24833:0:(import.c:65:import_set_state_nolock()) ffff9c2d37c0c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789446270.184674:0:24833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3656:x1876369794651264:12345-0@lo:8:kworker.0 Request processed in 198us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446270.184681:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789446270.184695:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789446270.184714:0:24833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3656:x1876369794651392:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789446270.184726:0:24833:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789446270.184757:0:24833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3656:x1876369794651392:12345-0@lo:8:kworker.0 Request processed in 42us (504us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789446270.184769:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789446270.184787:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789446270.184791:0:24833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3656:x1876369794651904:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789446270.184801:0:24833:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789446270.184833:0:24833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3656:x1876369794651904:12345-0@lo:8:kworker.0 Request processed in 40us (522us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789446270.184838:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789446270.184880:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794651648:0@lo:400:kworker.0 00010000:00080000:0.0:1789446270.184894:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2c07a92d80 x1876369794652288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446270.184905:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1876369794652288:0@lo:400:kworker.0 00010000:00080000:0.0:1789446270.184915:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2c07a90000 x1876369794651520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446270.184924:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1876369794651520:0@lo:400:kworker.0 00010000:00080000:0.0:1789446270.184934:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2c07a90700 x1876369794652160/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446270.184941:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1876369794652160:0@lo:400:kworker.0 00000100:00100000:0.0:1789446270.185079:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d369d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794651136:0@lo:400:kworker.0 00010000:00080000:0.0:1789446270.185090:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2c07a91880 x1876369794652032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446270.185098:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876369794652032:0@lo:400:kworker.0 00000100:00100000:0.0:1789446270.185107:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d369d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:282408b2-7484-4ad3-93ba-27093493daa8:3659:1876369794651008:0@lo:400:kworker.0 00010000:00080000:0.0:1789446270.185124:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2c07a90a80 x1876369794651776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789446286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446270.185132:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794651776:0@lo:400:kworker.0 00010000:00080000:0.0:1789446270.185183:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2d369d7800 x1876369794651264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789446295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446270.185190:0:3656:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789446270.185197:0:3656:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789446270.185205:0:3656:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789446270.185209:0:3656:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789446270.185212:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2c05b60800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789446270.185226:0:3656:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789446270.185231:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d369d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794651264:0@lo:8:kworker.0 00000004:00080000:2.0:1789446270.196911:0:22849:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1789446270.196937:0:22849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a78e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22849:1876369794652544:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789446270.197013:0:22849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446270.197041:0:22849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d187ea900 going to sleep for 11 seconds 00000004:00080000:2.0:1789446270.197057:0:22848:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789446270.197150:0:22848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 652271191800ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789446270.197166:0:22848:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1789446270.197462:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789446270.197476:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1876369794652416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789446270.197507:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446270.197540:0:24333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794652416 00000100:00100000:2.0:1789446270.197547:0:24333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794652416 00000100:00100000:2.0:1789446270.197595:0:24333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789446270.197605:0:24333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1876369794652416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789446270.197625:0:24333:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789446270.197670:0:24333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1876369794652416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446270.197684:0:24333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789446270.197704:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789446270.197732:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2c05a7ad80 x1876369794652416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789446286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446270.197748:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1876369794652416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789446270.197774:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794652544 00000100:00100000:2.0:1789446270.197778:0:24833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794652544 00000100:00100000:2.0:1789446270.197802:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789446270.197809:0:24833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22849:x1876369794652544:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1789446270.200618:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d187ae000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789446270.200628:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789446270.200635:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794651392:0@lo:8:kworker.0 00000100:00080000:0.0:1789446270.200667:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d3fea6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789446270.200670:0:3656:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789446270.200674:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794651904:0@lo:8:kworker.0 00000004:00080000:3.0:1789446270.206720:0:22804:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1789446270.212292:0:24833:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789446270.212306:0:24833:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:3.0:1789446270.212313:0:24833:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00002000:00010000:3.0:1789446270.226649:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789446270.226660:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022689755/0x62554ff3745508c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.226677:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=652s v=(0 0) 00010000:00010000:3.0:1789446270.226681:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789446270.226687:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022689755/0x62554ff3745508c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.226703:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022689755/0x62554ff3745508c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.226714:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022689755/0x62554ff3745508c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.226721:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022689755/0x62554ff3745508c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.226797:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789446270.227750:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789446270.227759:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010c04a1f/0x62554ff3745508ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.227770:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=652s v=(0 0) 00010000:00010000:0.0:1789446270.227774:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789446270.227787:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010c04a1f/0x62554ff3745508ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.227799:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010c04a1f/0x62554ff3745508ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.227808:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010c04a1f/0x62554ff3745508ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.227816:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010c04a1f/0x62554ff3745508ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.227983:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789446270.227992:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022689755/0x62554ff3745508c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.228001:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36807200 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:1.0:1789446270.228005:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022689755/0x62554ff3745508c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.228014:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022689755/0x62554ff3745508c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.228032:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022689755/0x62554ff3745508c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.228039:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022689755/0x62554ff3745508c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.230566:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789446270.230577:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010c04a1f/0x62554ff3745508ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.230589:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36a50000 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446270.230594:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010c04a1f/0x62554ff3745508ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.230605:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010c04a1f/0x62554ff3745508ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.230624:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010c04a1f/0x62554ff3745508ca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.230635:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446270.230636:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446270.230639:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.231610:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789446270.231620:0:24833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010c04a1f/0x62554ff3745508ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.231679:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789446270.234586:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789446270.234598:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9d5b080/0x62554ff3745508d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.234614:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=652s v=(0 0) 00010000:00010000:2.0:1789446270.234619:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446270.234625:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9d5b080/0x62554ff3745508d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.234639:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9d5b080/0x62554ff3745508d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.234649:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9d5b080/0x62554ff3745508d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.234656:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9d5b080/0x62554ff3745508d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.234685:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789446270.234996:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789446270.235002:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006900aaaa/0x62554ff3745508d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.235012:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=652s v=(0 0) 00010000:00010000:2.0:1789446270.235015:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446270.235020:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006900aaaa/0x62554ff3745508d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.235030:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006900aaaa/0x62554ff3745508d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.235050:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006900aaaa/0x62554ff3745508d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.235059:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006900aaaa/0x62554ff3745508d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.235074:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789446270.235084:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789446270.235089:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9d5b080/0x62554ff3745508d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.235097:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d35ea7a00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:2.0:1789446270.235107:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9d5b080/0x62554ff3745508d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.235118:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9d5b080/0x62554ff3745508d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.235134:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9d5b080/0x62554ff3745508d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.235153:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9d5b080/0x62554ff3745508d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.235171:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789446270.235174:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006900aaaa/0x62554ff3745508d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.235181:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d35ea6200 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:2.0:1789446270.235184:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006900aaaa/0x62554ff3745508d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.235191:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006900aaaa/0x62554ff3745508d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.235201:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006900aaaa/0x62554ff3745508d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.235209:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006900aaaa/0x62554ff3745508d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.235226:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446270.235228:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446270.235230:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.235948:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789446270.236165:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789446270.236173:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9513dc3/0x62554ff3745508df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.236185:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=652s v=(0 0) 00010000:00010000:2.0:1789446270.236189:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446270.236194:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9513dc3/0x62554ff3745508df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.236205:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9513dc3/0x62554ff3745508df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.236214:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9513dc3/0x62554ff3745508df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.236221:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9513dc3/0x62554ff3745508df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.236246:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789446270.236546:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446270.236553:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9513dc3/0x62554ff3745508df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.236562:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d35ea6e00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446270.236566:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9513dc3/0x62554ff3745508df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.236575:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9513dc3/0x62554ff3745508df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.236602:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9513dc3/0x62554ff3745508df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.236608:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9513dc3/0x62554ff3745508df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.236624:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.236625:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.236627:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789446270.238337:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789446270.238360:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e51777aa/0x62554ff3745508e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.238388:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=652s v=(0 0) 00010000:00010000:2.0:1789446270.238392:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446270.238398:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e51777aa/0x62554ff3745508e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.238410:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e51777aa/0x62554ff3745508e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.238419:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e51777aa/0x62554ff3745508e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.238426:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e51777aa/0x62554ff3745508e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.238451:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789446270.238637:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446270.238644:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e51777aa/0x62554ff3745508e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.238651:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d35ea6000 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446270.238655:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e51777aa/0x62554ff3745508e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.238664:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e51777aa/0x62554ff3745508e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.238678:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e51777aa/0x62554ff3745508e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.238686:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e51777aa/0x62554ff3745508e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.238716:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.238718:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.238720:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789446270.240133:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789446270.240155:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056d69b05/0x62554ff3745508ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.240179:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=652s v=(0 0) 00010000:00010000:2.0:1789446270.240183:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446270.240188:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056d69b05/0x62554ff3745508ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.240201:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056d69b05/0x62554ff3745508ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.240223:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056d69b05/0x62554ff3745508ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.240230:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056d69b05/0x62554ff3745508ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.240254:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789446270.240433:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446270.240439:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056d69b05/0x62554ff3745508ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.240448:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d35ea7400 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446270.240452:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056d69b05/0x62554ff3745508ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.240463:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056d69b05/0x62554ff3745508ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.240477:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056d69b05/0x62554ff3745508ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.240484:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056d69b05/0x62554ff3745508ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.240500:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.240502:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.240503:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789446270.241490:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789446270.241501:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083dcfe83/0x62554ff3745508f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.241513:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=652s v=(0 0) 00010000:00010000:2.0:1789446270.241518:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446270.241523:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083dcfe83/0x62554ff3745508f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.241534:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083dcfe83/0x62554ff3745508f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.241543:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083dcfe83/0x62554ff3745508f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.241551:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083dcfe83/0x62554ff3745508f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.241590:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789446270.241747:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446270.241752:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083dcfe83/0x62554ff3745508f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.241771:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d35ea7c00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446270.241775:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083dcfe83/0x62554ff3745508f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.241784:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083dcfe83/0x62554ff3745508f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.241798:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083dcfe83/0x62554ff3745508f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.241805:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083dcfe83/0x62554ff3745508f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.241820:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.241822:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.241824:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789446270.242409:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789446270.242416:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4a7456c/0x62554ff3745508fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.242426:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=652s v=(0 0) 00010000:00010000:2.0:1789446270.242429:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446270.242433:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4a7456c/0x62554ff3745508fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.242443:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4a7456c/0x62554ff3745508fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.242450:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4a7456c/0x62554ff3745508fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.242456:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4a7456c/0x62554ff3745508fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.242476:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789446270.242606:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446270.242612:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4a7456c/0x62554ff3745508fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.242620:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d35ea7600 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446270.242624:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4a7456c/0x62554ff3745508fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.242632:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4a7456c/0x62554ff3745508fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.242652:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4a7456c/0x62554ff3745508fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.242659:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4a7456c/0x62554ff3745508fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.242674:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.242676:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.242678:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789446270.247515:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789446270.247529:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6b66689/0x62554ff374550902 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.247546:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=652s v=(0 0) 00010000:00010000:2.0:1789446270.247559:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446270.247566:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6b66689/0x62554ff374550902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.247581:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6b66689/0x62554ff374550902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.247592:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6b66689/0x62554ff374550902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.247600:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6b66689/0x62554ff374550902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.247624:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789446270.247837:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446270.247844:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6b66689/0x62554ff374550902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.247854:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d35ea6800 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446270.247858:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6b66689/0x62554ff374550902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.247867:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6b66689/0x62554ff374550902 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.247883:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6b66689/0x62554ff374550902 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.247891:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6b66689/0x62554ff374550902 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.247919:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.247921:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.247923:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789446270.248332:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789446270.248338:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c965f922/0x62554ff374550909 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.248356:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=652s v=(0 0) 00010000:00010000:2.0:1789446270.248360:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446270.248365:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c965f922/0x62554ff374550909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.248376:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c965f922/0x62554ff374550909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.248385:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c965f922/0x62554ff374550909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.248398:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c965f922/0x62554ff374550909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.248418:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789446270.248544:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446270.248550:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c965f922/0x62554ff374550909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.248558:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d42054c00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446270.248562:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c965f922/0x62554ff374550909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.248571:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c965f922/0x62554ff374550909 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.248584:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c965f922/0x62554ff374550909 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.248590:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c965f922/0x62554ff374550909 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.248605:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.248607:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.248609:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789446270.248822:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789446270.248827:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b8a500a/0x62554ff374550910 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.248835:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=652s v=(0 0) 00010000:00010000:2.0:1789446270.248839:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446270.248842:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b8a500a/0x62554ff374550910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.248851:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b8a500a/0x62554ff374550910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.248860:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b8a500a/0x62554ff374550910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.248867:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b8a500a/0x62554ff374550910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.248886:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789446270.249076:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446270.249081:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b8a500a/0x62554ff374550910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.249101:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d42055800 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446270.249105:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b8a500a/0x62554ff374550910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.249112:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b8a500a/0x62554ff374550910 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.249123:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b8a500a/0x62554ff374550910 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.249130:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b8a500a/0x62554ff374550910 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.249155:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.249156:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.249158:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789446270.251207:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789446270.251221:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeaba903/0x62554ff374550917 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.251251:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=652s v=(0 0) 00010000:00010000:2.0:1789446270.251254:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446270.251260:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eeaba903/0x62554ff374550917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.251274:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eeaba903/0x62554ff374550917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.251284:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeaba903/0x62554ff374550917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.251292:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eeaba903/0x62554ff374550917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.251318:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789446270.251525:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446270.251532:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eeaba903/0x62554ff374550917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.251540:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d42054000 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446270.251544:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeaba903/0x62554ff374550917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.251553:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeaba903/0x62554ff374550917 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.251576:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eeaba903/0x62554ff374550917 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.251583:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eeaba903/0x62554ff374550917 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.251602:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.251604:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.251606:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789446270.252282:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789446270.252289:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048500bc8/0x62554ff37455091e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.252299:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=652s v=(0 0) 00010000:00010000:2.0:1789446270.252303:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446270.252307:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048500bc8/0x62554ff37455091e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.252317:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048500bc8/0x62554ff37455091e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.252338:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048500bc8/0x62554ff37455091e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.252345:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048500bc8/0x62554ff37455091e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.253286:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789446270.255490:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789446270.255504:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7292305/0x62554ff374550925 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.255521:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=652s v=(0 0) 00010000:00010000:2.0:1789446270.255525:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446270.255530:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7292305/0x62554ff374550925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.255542:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7292305/0x62554ff374550925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.255551:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7292305/0x62554ff374550925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.255558:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7292305/0x62554ff374550925 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.260166:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789446270.260180:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048500bc8/0x62554ff37455091e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.260193:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d13ba7200 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446270.260198:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048500bc8/0x62554ff37455091e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.260209:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048500bc8/0x62554ff37455091e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.260230:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048500bc8/0x62554ff37455091e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.260237:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048500bc8/0x62554ff37455091e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.260282:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446270.260286:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7292305/0x62554ff374550925 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.260294:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d13ba6600 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446270.260297:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7292305/0x62554ff374550925 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.260305:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7292305/0x62554ff374550925 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.260315:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7292305/0x62554ff374550925 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.260323:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.260324:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.260326:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446270.269800:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789446270.269814:0:24833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7292305/0x62554ff374550925 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.270099:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789446270.270820:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789446270.270830:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fb9c354/0x62554ff37455092c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.270843:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=652s v=(0 0) 00010000:00010000:3.0:1789446270.270848:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789446270.270853:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fb9c354/0x62554ff37455092c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.270874:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fb9c354/0x62554ff37455092c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.270884:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fb9c354/0x62554ff37455092c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.270893:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fb9c354/0x62554ff37455092c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.270918:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789446270.271159:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789446270.271166:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fb9c354/0x62554ff37455092c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.271174:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36806200 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:1.0:1789446270.271178:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fb9c354/0x62554ff37455092c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.271186:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fb9c354/0x62554ff37455092c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.271213:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fb9c354/0x62554ff37455092c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.271220:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fb9c354/0x62554ff37455092c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.271235:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446270.271237:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446270.271239:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789446270.271405:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789446270.271410:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ad2e9ef/0x62554ff374550933 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.271419:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=652s v=(0 0) 00010000:00010000:3.0:1789446270.271422:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789446270.271426:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ad2e9ef/0x62554ff374550933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.271436:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ad2e9ef/0x62554ff374550933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.271444:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ad2e9ef/0x62554ff374550933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.271462:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ad2e9ef/0x62554ff374550933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.271486:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789446270.271746:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789446270.271752:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ad2e9ef/0x62554ff374550933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.271760:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36807e00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:1.0:1789446270.271764:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ad2e9ef/0x62554ff374550933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.271772:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ad2e9ef/0x62554ff374550933 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.271784:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ad2e9ef/0x62554ff374550933 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.271791:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ad2e9ef/0x62554ff374550933 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.271816:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446270.271818:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446270.271819:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789446270.273156:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789446270.273168:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000832795b2/0x62554ff37455093a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.273182:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=652s v=(0 0) 00010000:00010000:3.0:1789446270.273185:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789446270.273190:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000832795b2/0x62554ff37455093a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.273202:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000832795b2/0x62554ff37455093a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.273213:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000832795b2/0x62554ff37455093a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.273221:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000832795b2/0x62554ff37455093a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.273247:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789446270.273437:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789446270.273443:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000832795b2/0x62554ff37455093a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.273451:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36807a00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:1.0:1789446270.273454:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000832795b2/0x62554ff37455093a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.273463:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000832795b2/0x62554ff37455093a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.273478:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000832795b2/0x62554ff37455093a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.273484:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000832795b2/0x62554ff37455093a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.273502:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446270.273503:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446270.273505:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789446270.273866:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789446270.273873:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a168d7fb/0x62554ff374550941 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.273891:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=652s v=(0 0) 00010000:00010000:3.0:1789446270.273895:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789446270.273899:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a168d7fb/0x62554ff374550941 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.273908:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a168d7fb/0x62554ff374550941 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.273917:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a168d7fb/0x62554ff374550941 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.273925:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a168d7fb/0x62554ff374550941 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.273953:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789446270.274273:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789446270.274279:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a168d7fb/0x62554ff374550941 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.274299:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36806600 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:1.0:1789446270.274303:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a168d7fb/0x62554ff374550941 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.274310:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a168d7fb/0x62554ff374550941 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.274323:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a168d7fb/0x62554ff374550941 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.274330:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a168d7fb/0x62554ff374550941 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.274344:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446270.274357:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446270.274358:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789446270.276797:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789446270.276810:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000573db4b8/0x62554ff374550948 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.276826:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=652s v=(0 0) 00010000:00010000:3.0:1789446270.276831:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789446270.276837:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000573db4b8/0x62554ff374550948 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.276852:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000573db4b8/0x62554ff374550948 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.276880:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000573db4b8/0x62554ff374550948 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.276889:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000573db4b8/0x62554ff374550948 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.276912:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789446270.278452:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789446270.278464:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c861671/0x62554ff37455094f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.278477:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=652s v=(0 0) 00010000:00010000:3.0:1789446270.278480:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789446270.278485:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c861671/0x62554ff37455094f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.278498:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c861671/0x62554ff37455094f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.278507:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c861671/0x62554ff37455094f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.278515:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c861671/0x62554ff37455094f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.278548:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789446270.278563:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789446270.278569:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000573db4b8/0x62554ff374550948 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.278577:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36806e00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446270.278581:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000573db4b8/0x62554ff374550948 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.278590:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000573db4b8/0x62554ff374550948 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.278605:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000573db4b8/0x62554ff374550948 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.278613:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000573db4b8/0x62554ff374550948 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.278629:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789446270.278632:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c861671/0x62554ff37455094f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.278638:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36806a00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446270.278641:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c861671/0x62554ff37455094f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.280486:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446270.280586:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c861671/0x62554ff37455094f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.280606:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c861671/0x62554ff37455094f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.280614:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c861671/0x62554ff37455094f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.280633:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446270.280635:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446270.280637:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789446270.287867:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789446270.287881:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010c04a1f/0x62554ff374550956 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.287897:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=652s v=(0 0) 00010000:00010000:0.0:1789446270.287901:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789446270.287907:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010c04a1f/0x62554ff374550956 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.287935:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010c04a1f/0x62554ff374550956 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.287946:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010c04a1f/0x62554ff374550956 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.287952:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010c04a1f/0x62554ff374550956 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.287998:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789446270.289319:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789446270.289329:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010c04a1f/0x62554ff374550956 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.289339:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36a50000 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:2.0:1789446270.289343:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010c04a1f/0x62554ff374550956 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.289364:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010c04a1f/0x62554ff374550956 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.289383:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010c04a1f/0x62554ff374550956 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.289390:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010c04a1f/0x62554ff374550956 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.289406:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446270.289408:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446270.289409:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789446270.291441:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789446270.291453:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090ff6461/0x62554ff37455095d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.291469:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=652s v=(0 0) 00010000:00010000:1.0:1789446270.291473:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446270.291479:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090ff6461/0x62554ff37455095d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.291508:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090ff6461/0x62554ff37455095d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.291520:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090ff6461/0x62554ff37455095d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.291527:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090ff6461/0x62554ff37455095d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.291639:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789446270.298590:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789446270.298604:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2df1eae/0x62554ff374550964 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.298621:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=652s v=(0 0) 00010000:00010000:1.0:1789446270.298626:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446270.298631:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2df1eae/0x62554ff374550964 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.298645:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2df1eae/0x62554ff374550964 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.298656:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2df1eae/0x62554ff374550964 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.298682:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2df1eae/0x62554ff374550964 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.299784:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789446270.299801:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090ff6461/0x62554ff37455095d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.299811:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9da00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:2.0:1789446270.299816:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ff6461/0x62554ff37455095d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.299827:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ff6461/0x62554ff37455095d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.299846:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090ff6461/0x62554ff37455095d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.299853:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090ff6461/0x62554ff37455095d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.299870:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789446270.299874:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2df1eae/0x62554ff374550964 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.299880:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9d000 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:2.0:1789446270.299882:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2df1eae/0x62554ff374550964 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.299888:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2df1eae/0x62554ff374550964 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.299907:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2df1eae/0x62554ff374550964 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.299914:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446270.299916:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446270.299918:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446270.303070:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789446270.303085:0:24833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2df1eae/0x62554ff374550964 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.303453:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789446270.303927:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789446270.303935:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d919f10/0x62554ff37455096b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.303985:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=652s v=(0 0) 00010000:00010000:1.0:1789446270.303990:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446270.303996:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d919f10/0x62554ff37455096b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.304009:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d919f10/0x62554ff37455096b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.304018:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d919f10/0x62554ff37455096b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.304026:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d919f10/0x62554ff37455096b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.304056:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789446270.304522:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789446270.304528:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009818ae81/0x62554ff374550972 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.304537:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=652s v=(0 0) 00010000:00010000:1.0:1789446270.304539:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446270.304544:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009818ae81/0x62554ff374550972 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.304552:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009818ae81/0x62554ff374550972 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.304561:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009818ae81/0x62554ff374550972 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.304568:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009818ae81/0x62554ff374550972 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.304582:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789446270.305157:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789446270.305165:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d919f10/0x62554ff37455096b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.305174:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9d200 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446270.305179:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d919f10/0x62554ff37455096b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.305188:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d919f10/0x62554ff37455096b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.305205:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d919f10/0x62554ff37455096b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.305224:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d919f10/0x62554ff37455096b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.305241:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789446270.305245:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009818ae81/0x62554ff374550972 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.305251:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9ce00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446270.305254:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009818ae81/0x62554ff374550972 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.305261:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009818ae81/0x62554ff374550972 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.305271:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009818ae81/0x62554ff374550972 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.305278:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009818ae81/0x62554ff374550972 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.305290:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446270.305292:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446270.305293:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446270.305298:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789446270.307125:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789446270.307160:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c861671/0x62554ff374550979 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.307173:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=652s v=(0 0) 00010000:00010000:3.0:1789446270.307177:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789446270.307183:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c861671/0x62554ff374550979 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.307196:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c861671/0x62554ff374550979 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.307205:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c861671/0x62554ff374550979 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.307213:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c861671/0x62554ff374550979 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.307230:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789446270.307720:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789446270.307727:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000573db4b8/0x62554ff374550980 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.307735:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=652s v=(0 0) 00010000:00010000:3.0:1789446270.307739:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789446270.307742:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000573db4b8/0x62554ff374550980 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.307752:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000573db4b8/0x62554ff374550980 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.307765:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000573db4b8/0x62554ff374550980 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.307772:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000573db4b8/0x62554ff374550980 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.307825:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789446270.312985:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789446270.312999:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c861671/0x62554ff374550979 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.313012:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36806a00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:1.0:1789446270.313034:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c861671/0x62554ff374550979 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.313046:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c861671/0x62554ff374550979 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.313068:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c861671/0x62554ff374550979 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.313076:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c861671/0x62554ff374550979 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.313126:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789446270.313130:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000573db4b8/0x62554ff374550980 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.313149:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36806e00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:1.0:1789446270.313153:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000573db4b8/0x62554ff374550980 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.313160:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000573db4b8/0x62554ff374550980 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.313169:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000573db4b8/0x62554ff374550980 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.313176:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000573db4b8/0x62554ff374550980 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.313196:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446270.313197:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446270.313200:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446270.313588:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789446270.314525:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789446270.314534:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ac77846/0x62554ff374550987 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.314548:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=652s v=(0 0) 00010000:00010000:1.0:1789446270.314553:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446270.314559:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ac77846/0x62554ff374550987 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.314572:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ac77846/0x62554ff374550987 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.314582:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ac77846/0x62554ff374550987 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.314590:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ac77846/0x62554ff374550987 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.314645:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789446270.316170:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789446270.316183:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d676cf9a/0x62554ff37455098e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.316214:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=652s v=(0 0) 00010000:00010000:1.0:1789446270.316218:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446270.316223:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d676cf9a/0x62554ff37455098e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.316236:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d676cf9a/0x62554ff37455098e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.316245:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d676cf9a/0x62554ff37455098e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.316253:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d676cf9a/0x62554ff37455098e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.319126:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789446270.319147:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ac77846/0x62554ff374550987 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.319160:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9d800 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446270.319165:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ac77846/0x62554ff374550987 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.319176:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ac77846/0x62554ff374550987 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.319195:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ac77846/0x62554ff374550987 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.319203:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ac77846/0x62554ff374550987 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.319234:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789446270.319238:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d676cf9a/0x62554ff37455098e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.319244:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9c200 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446270.319247:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d676cf9a/0x62554ff37455098e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.319253:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d676cf9a/0x62554ff37455098e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.319263:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d676cf9a/0x62554ff37455098e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.319270:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446270.319271:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446270.319273:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446270.321635:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789446270.321646:0:24833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d676cf9a/0x62554ff37455098e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.322027:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789446270.322687:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789446270.322695:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2df1eae/0x62554ff374550995 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.322709:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=652s v=(0 0) 00010000:00010000:1.0:1789446270.322713:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446270.322718:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2df1eae/0x62554ff374550995 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.322743:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2df1eae/0x62554ff374550995 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.322754:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2df1eae/0x62554ff374550995 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.322762:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2df1eae/0x62554ff374550995 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.322786:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789446270.323188:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789446270.323196:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2df1eae/0x62554ff374550995 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.323205:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9d000 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446270.323209:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2df1eae/0x62554ff374550995 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.323230:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2df1eae/0x62554ff374550995 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.323247:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2df1eae/0x62554ff374550995 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.323254:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2df1eae/0x62554ff374550995 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.323271:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446270.323273:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446270.323275:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789446270.323488:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789446270.323494:0:24833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d663376c/0x62554ff37455099c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.323503:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=652s v=(0 0) 00010000:00010000:1.0:1789446270.323506:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446270.323511:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d663376c/0x62554ff37455099c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.323521:0:24833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d663376c/0x62554ff37455099c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.323528:0:24833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d663376c/0x62554ff37455099c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.323546:0:24833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d663376c/0x62554ff37455099c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.323567:0:24833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789446270.323784:0:24833:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:1.0:1789446270.323874:0:24833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22849:x1876369794652544:12345-0@lo:5:osp-pre-0-0.0 Request processed in 126062us (126857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446270.323883:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1789446270.323953:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789446270.323992:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d663376c/0x62554ff37455099c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.324000:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9c800 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446270.324003:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d663376c/0x62554ff37455099c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.324012:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d663376c/0x62554ff37455099c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.324024:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d663376c/0x62554ff37455099c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.324043:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d663376c/0x62554ff37455099c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.324059:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446270.324061:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446270.324063:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789446270.325087:0:22849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a78e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22849:1876369794652544:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789446270.325104:0:22849:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1789446270.325163:0:22849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08190a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22849:1876369794652672:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789446270.325203:0:22849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446270.325234:0:22849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d2ea62840 going to sleep for 11 seconds 00000100:00100000:1.0:1789446270.325560:0:24331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794652672 00000100:00100000:1.0:1789446270.325568:0:24331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794652672 00000100:00100000:1.0:1789446270.325618:0:24331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789446270.325627:0:24331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d08192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22849:x1876369794652672:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789446270.325663:0:24331:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:1.0:1789446270.340523:0:24326:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1789446270.340566:0:24326:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789446270.341218:0:24331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d08192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22849:x1876369794652672:12345-0@lo:5:osp-pre-0-0.0 Request processed in 15587us (16008us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1789446270.341230:0:24331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789446270.342134:0:22849:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1789446270.342156:0:22849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08190a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22849:1876369794652672:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789446270.342172:0:22849:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000020:01000004:1.0:1789446270.449441:0:25145:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789446270.449445:0:25145:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789446270.449446:0:25145:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789446270.449582:0:25145:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c2c07a6f000 00000020:01000004:1.0:1789446270.449774:0:25145:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789446270.449789:0:25145:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789446270.449803:0:25145:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c2c06678000) 00000020:00000080:1.0:1789446270.449821:0:25145:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789446270.547674:0:25145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789446270.549820:0:25145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789446270.552065:0:25145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789446270.553591:0:25145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789446270.554738:0:25145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789446270.555162:0:25145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789446270.555540:0:25145:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1789446270.567666:0:25145:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789446270.567904:0:25145:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789446270.567919:0:25145:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789446270.567932:0:25145:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x62554ff3745509aa 00000020:01000004:3.0:1789446270.567940:0:25145:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789446270.570587:0:25145:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.148@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789446270.570595:0:25145:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789446270.570606:0:25145:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789446270.570652:0:25145:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789446270.570657:0:25145:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789446270.593111:0:25145:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789446270.593158:0:25145:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.148@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789446270.593162:0:25145:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789446270.593163:0:25145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789446270.593165:0:25145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789446270.593166:0:25145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789446270.593167:0:25145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789446270.593168:0:25145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789446270.593169:0:25145:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789446270.593171:0:25145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789446270.593172:0:25145:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789446270.593176:0:25145:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789446270.593177:0:25145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789446270.593179:0:25145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789446270.593180:0:25145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789446270.593181:0:25145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789446270.593182:0:25145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789446270.593182:0:25145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789446270.593183:0:25145:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789446270.593184:0:25145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789446270.593185:0:25145:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789446270.593208:0:25145:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789446270.593226:0:25145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794652800:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789446270.593301:0:25145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446270.593628:0:25145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d04a37900 going to sleep for 11 seconds 00000100:00100000:0.0:1789446270.593677:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794652800 00000100:00100000:0.0:1789446270.593686:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794652800 00000100:00100000:0.0:1789446270.593737:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789446270.593744:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+21:25145:x1876369794652800:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789446270.593780:0:22818:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789446270.593782:0:22818:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789446270.593786:0:22818:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789446270.594588:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+21:25145:x1876369794652800:12345-0@lo:253:mount.lustre.0 Request processed in 839us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446270.594597:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789446270.594672:0:25145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794652800:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789446270.594682:0:25145:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789446270.594684:0:25145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789446270.594685:0:25145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789446270.594687:0:25145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789446270.594688:0:25145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789446270.594689:0:25145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789446270.594689:0:25145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789446270.594690:0:25145:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789446270.594691:0:25145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789446270.594692:0:25145:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789446270.594710:0:25145:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c2c07a6f000 from lustre-OST0001 10000000:01000000:2.0:1789446270.594735:0:25145:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789446270.594737:0:25145:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789446270.594745:0:25145:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c2c069e0000 local copy 00010000:00010000:2.0:1789446270.594753:0:25145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50400/0x62554ff3745505dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745505e4 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446270.595042:0:25145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794652928:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789446270.595075:0:25145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446270.595156:0:25145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d04a37180 going to sleep for 11 seconds 00000100:00100000:0.0:1789446270.595192:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794652928 00000100:00100000:0.0:1789446270.595197:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794652928 00000100:00100000:0.0:1789446270.595263:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789446270.595271:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+21:25145:x1876369794652928:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789446270.595632:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+21:25145:x1876369794652928:12345-0@lo:501:mount.lustre.0 Request processed in 362us (555us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789446270.595639:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789446270.595724:0:25145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a7ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794652928:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789446270.595745:0:25145:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789446270.595765:0:25145:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789446270.595771:0:25145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50400/0x62554ff3745505dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745505e4 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.595780:0:25145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50400/0x62554ff3745505dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745505e4 expref: -99 pid: 22803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789446270.595803:0:25145:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c2c07a6f000 10000000:01000000:3.0:1789446270.595807:0:25145:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789446270.595812:0:25145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789446270.595814:0:25145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789446270.595818:0:25145:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789446270.595821:0:25145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789446270.595842:0:25145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36806e00/0x62554ff3745509b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.595850:0:25145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d36806e00/0x62554ff3745509b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.595858:0:25145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d36806e00/0x62554ff3745509b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446270.595870:0:25145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08190380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794653056:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789446270.595897:0:25145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446270.595953:0:25145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d04d39c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789446270.596018:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794653056 00000100:00100000:0.0:1789446270.596022:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794653056 00000100:00100000:0.0:1789446270.596076:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789446270.596083:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+21:25145:x1876369794653056:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789446270.596091:0:22816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789446270.596101:0:22816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d36a51a00/0x62554ff3745509b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff3745509b1 expref: -99 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.596119:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d36a51a00/0x62554ff3745509b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff3745509b1 expref: 22 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.596127:0:22816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d36a51a00/0x62554ff3745509b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff3745509b1 expref: 22 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.596134:0:22816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d36a51a00, rc 0) 00000100:00100000:0.0:1789446270.596189:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+22:25145:x1876369794653056:12345-0@lo:101:mount.lustre.0 Request processed in 106us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446270.596195:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789446270.596213:0:25145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08190380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794653056:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789446270.596230:0:25145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d36806e00/0x62554ff3745509b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745509b8 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.596240:0:25145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d36806e00/0x62554ff3745509b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff3745509b8 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789446270.604554:0:25145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1789446270.606726:0:25145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789446270.612171:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1789446270.612223:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1789446270.612234:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1789446270.612247:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1789446270.612257:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1789446270.612270:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1789446270.612281:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1789446270.612291:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1789446270.612301:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1789446270.612322:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1789446270.612327:0:25145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1789446270.612495:0:25145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08192300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794653184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789446270.614330:0:25145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446270.614504:0:25145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d05308240 going to sleep for 11 seconds 00000100:00100000:3.0:1789446270.614673:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794653184 00000100:00100000:3.0:1789446270.614682:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794653184 00000100:00100000:3.0:1789446270.614777:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789446270.614787:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+22:25145:x1876369794653184:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789446270.614987:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+22:25145:x1876369794653184:12345-0@lo:501:mount.lustre.0 Request processed in 172us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446270.614995:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789446270.615090:0:25145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08192300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794653184:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789446270.615147:0:25145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794653312:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789446270.615199:0:25145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446270.615233:0:25145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d36b7e780 going to sleep for 11 seconds 00000100:00100000:3.0:1789446270.615264:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794653312 00000100:00100000:3.0:1789446270.615269:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794653312 00000100:00100000:3.0:1789446270.615298:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789446270.615304:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+22:25145:x1876369794653312:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789446270.616045:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+22:25145:x1876369794653312:12345-0@lo:503:mount.lustre.0 Request processed in 738us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446270.616054:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789446270.616540:0:25145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794653312:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789446270.617011:0:25145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789446270.617101:0:25145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794653440:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789446270.617159:0:25145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446270.617195:0:25145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d36b7e900 going to sleep for 11 seconds 00000100:00100000:3.0:1789446270.617390:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794653440 00000100:00100000:3.0:1789446270.617397:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794653440 00000100:00100000:3.0:1789446270.617431:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789446270.617439:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+22:25145:x1876369794653440:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789446270.618033:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+22:25145:x1876369794653440:12345-0@lo:502:mount.lustre.0 Request processed in 591us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446270.618042:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789446270.619636:0:25145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794653440:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789446270.619899:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1789446270.619928:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1789446270.619951:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1789446270.619989:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1789446270.620005:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1789446270.620018:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1789446270.620030:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1789446270.620113:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1789446270.620149:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1789446270.620188:0:25145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794653568:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789446270.620372:0:25145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446270.620549:0:25145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d36b7e900 going to sleep for 11 seconds 00000100:00100000:2.0:1789446270.620673:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794653568 00000100:00100000:2.0:1789446270.620682:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794653568 00000100:00100000:2.0:1789446270.620745:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789446270.620754:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+22:25145:x1876369794653568:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789446270.620872:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+22:25145:x1876369794653568:12345-0@lo:502:mount.lustre.0 Request processed in 119us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446270.620880:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789446270.621039:0:25145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794653568:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789446270.621101:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1789446270.621110:0:25145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1789446270.625200:0:25149:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789446270.625210:0:25149:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1789446270.625217:0:25149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789446270.625219:0:25149:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789446270.625228:0:25149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789446270.625316:0:25149:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c2d2060cd40) 00000020:00000080:1.0:1789446270.625345:0:25149:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789446270.625352:0:25149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789446270.625504:0:25149:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2c07a6f000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789446270.625513:0:25149:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789446270.625520:0:25149:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x62554ff3745509c6 00010000:00010000:1.0:1789446270.638206:0:25149:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1789446270.639862:0:25149:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:1.0:1789446270.641194:0:25149:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1789446270.645851:0:25149:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789446270.645864:0:25149:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789446270.645871:0:25149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789446270.645878:0:25149:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789446270.645882:0:25149:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789446270.645886:0:25149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789446270.645887:0:25149:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789446270.645890:0:25149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789446270.645892:0:25149:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789446270.645895:0:25149:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789446270.645897:0:25149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789446270.645898:0:25149:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789446270.645901:0:25149:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789446270.645903:0:25149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789446270.645904:0:25149:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789446270.645908:0:25149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789446270.645936:0:25149:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789446270.645939:0:25149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789446270.645940:0:25149:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789446270.645944:0:25149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1789446270.646264:0:25145:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789446270.646294:0:25145:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789446270.646326:0:25145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36806e00/0x62554ff3745509b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745509b8 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.646357:0:25145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d36806e00/0x62554ff3745509b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745509b8 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446270.646365:0:25145:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c2c07a6f000 from 1 10000000:01000000:0.0:1789446270.646368:0:25145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789446270.646403:0:25145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50800/0x62554ff3745509cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.646411:0:25145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50800/0x62554ff3745509cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.646422:0:25145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50800/0x62554ff3745509cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446270.646445:0:25145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08063100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794653696:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789446270.646521:0:25145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446270.646593:0:25145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d07f55a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789446270.646806:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794653696 00000100:00100000:2.0:1789446270.646813:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794653696 00000100:00100000:2.0:1789446270.646858:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789446270.646867:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+22:25145:x1876369794653696:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789446270.646879:0:22816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789446270.646892:0:22816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d13ba6600/0x62554ff3745509d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff3745509cd expref: -99 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.646915:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d13ba6600/0x62554ff3745509d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff3745509cd expref: 23 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.646925:0:22816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d13ba6600/0x62554ff3745509d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff3745509cd expref: 23 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.646933:0:22816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d13ba6600, rc 0) 00000100:00100000:2.0:1789446270.647013:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+23:25145:x1876369794653696:12345-0@lo:101:mount.lustre.0 Request processed in 147us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446270.647020:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789446270.647152:0:25145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08063100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794653696:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789446270.647169:0:25145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50800/0x62554ff3745509cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745509d4 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.647179:0:25145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50800/0x62554ff3745509cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff3745509d4 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789446270.648443:0:25145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1789446270.649240:0:25145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789446270.651204:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1789446270.651245:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1789446270.651266:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1789446270.651277:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1789446270.651286:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1789446270.651295:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1789446270.651305:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1789446270.651314:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1789446270.651337:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1789446270.652681:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1789446270.652719:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1789446270.652738:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1789446270.652742:0:25145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1789446270.652842:0:25145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08063100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794653824:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789446270.652901:0:25145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446270.653194:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794653824 00000100:00100000:3.0:1789446270.653202:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794653824 00000100:00100000:3.0:1789446270.653270:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789446270.653280:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+23:25145:x1876369794653824:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789446270.653651:0:25145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d07f55480 going to sleep for 11 seconds 00000100:00100000:3.0:1789446270.657929:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+23:25145:x1876369794653824:12345-0@lo:501:mount.lustre.0 Request processed in 4645us (5021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446270.657944:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789446270.658041:0:25145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08063100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794653824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789446270.658091:0:25145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794653952:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789446270.658159:0:25145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446270.658188:0:25145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d04d39c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789446270.658251:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794653952 00000100:00100000:2.0:1789446270.658257:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794653952 00000100:00100000:2.0:1789446270.658288:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789446270.658294:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+23:25145:x1876369794653952:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789446270.658408:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+23:25145:x1876369794653952:12345-0@lo:503:mount.lustre.0 Request processed in 113us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446270.658414:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789446270.658605:0:25145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794653952:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789446270.658993:0:25145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789446270.659063:0:25145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08061180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794654080:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789446270.659107:0:25145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446270.659161:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794654080 00000100:00100000:3.0:1789446270.659168:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794654080 00000100:00100000:0.0:1789446270.659176:0:25145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d07f55a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789446270.659203:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789446270.659210:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+23:25145:x1876369794654080:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789446270.659386:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+23:25145:x1876369794654080:12345-0@lo:502:mount.lustre.0 Request processed in 176us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446270.659394:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789446270.659954:0:25145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08061180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794654080:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789446270.660222:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1789446270.660262:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1789446270.660296:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1789446270.660311:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1789446270.660324:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1789446270.660337:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1789446270.660349:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1789446270.660360:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1789446270.660370:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1789446270.660390:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1789446270.660401:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1789446270.660443:0:25145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08061180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794654208:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789446270.660492:0:25145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446270.660562:0:25145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d07f55a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789446270.660598:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794654208 00000100:00100000:1.0:1789446270.660604:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794654208 00000100:00100000:1.0:1789446270.660643:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789446270.660650:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+23:25145:x1876369794654208:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789446270.660745:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+23:25145:x1876369794654208:12345-0@lo:502:mount.lustre.0 Request processed in 95us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446270.660752:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789446270.660877:0:25145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08061180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794654208:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789446270.660921:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1789446270.660930:0:25145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789446270.665804:0:25153:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789446270.665817:0:25153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789446270.665819:0:25153:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789446270.665827:0:25153:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c2c07a6f000 00000020:00000080:0.0:1789446270.665829:0:25153:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789446270.665838:0:25153:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789446270.665840:0:25153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789446270.665842:0:25153:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789446270.665844:0:25153:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789446270.665846:0:25153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789446270.665847:0:25153:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789446270.665850:0:25153:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c2c07a6f000 00000020:00000080:0.0:1789446270.665853:0:25153:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789446270.665905:0:25153:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789446270.665908:0:25153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789446270.665909:0:25153:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789446270.665912:0:25153:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789446270.665914:0:25153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789446270.665916:0:25153:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789446270.665919:0:25153:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c2c07a6f000 00000020:00000080:0.0:1789446270.665920:0:25153:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789446270.665937:0:25153:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789446270.665939:0:25153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789446270.665941:0:25153:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789446270.665985:0:25153:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789446270.665990:0:25153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789446270.665991:0:25153:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789446270.665995:0:25153:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c2c07a6f000 00000020:00000080:0.0:1789446270.665997:0:25153:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789446270.666024:0:25153:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789446270.666028:0:25153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789446270.666029:0:25153:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789446270.666032:0:25153:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1789446270.666236:0:25145:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789446270.666280:0:25145:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789446270.666304:0:25145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50800/0x62554ff3745509cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745509d4 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.666316:0:25145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50800/0x62554ff3745509cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745509d4 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789446270.666365:0:25145:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789446270.666368:0:25145:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c2c07a6f000 10000000:01000000:1.0:1789446270.666371:0:25145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c2c07a6f000 10000000:01000000:1.0:1789446270.666374:0:25145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789446270.666379:0:25145:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c2c07a6f000 from 1 10000000:01000000:1.0:1789446270.666381:0:25145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789446270.666413:0:25145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c200/0x62554ff3745509db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.666589:0:25145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c200/0x62554ff3745509db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.666613:0:25145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c200/0x62554ff3745509db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446270.666637:0:25145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794654336:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789446270.666697:0:25145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446270.666847:0:25145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c07becf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789446270.666894:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794654336 00000100:00100000:2.0:1789446270.666901:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794654336 00000100:00100000:2.0:1789446270.666945:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789446270.667178:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+23:25145:x1876369794654336:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789446270.667194:0:22818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789446270.667208:0:22818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d13ba7e00/0x62554ff3745509e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff3745509db expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.667232:0:22818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d13ba7e00/0x62554ff3745509e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff3745509db expref: 24 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.668037:0:22818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d13ba7e00/0x62554ff3745509e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff3745509db expref: 24 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446270.668051:0:22818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d13ba7e00, rc 0) 00000100:00100000:2.0:1789446270.668108:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+24:25145:x1876369794654336:12345-0@lo:101:mount.lustre.0 Request processed in 1155us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446270.668115:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789446270.668534:0:25145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794654336:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789446270.668553:0:25145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c200/0x62554ff3745509db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745509e2 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.668564:0:25145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c200/0x62554ff3745509db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff3745509e2 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789446270.677470:0:25145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1789446270.677929:0:25145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789446270.678176:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1789446270.678199:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1789446270.678214:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1789446270.678229:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1789446270.678247:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1789446270.678261:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1789446270.678274:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1789446270.678288:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1789446270.678313:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1789446270.678323:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1789446270.678337:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1789446270.678584:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1789446270.678606:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1789446270.678620:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1789446270.678635:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1789446270.678648:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1789446270.678662:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1789446270.678676:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1789446270.678690:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1789446270.678704:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1789446270.678721:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1789446270.678735:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1789446270.678756:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1789446270.679502:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1789446270.679877:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1789446270.679898:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1789446270.679912:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1789446270.679926:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1789446270.679940:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1789446270.679953:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1789446270.680016:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1789446270.680027:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1789446270.680037:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1789446270.680050:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1789446270.680061:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1789446270.680071:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1789446270.680080:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1789446270.680090:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1789446270.680099:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1789446270.680109:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1789446270.680130:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1789446270.681745:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1789446270.682340:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1789446270.682889:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1789446270.682908:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1789446270.682929:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1789446270.682947:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1789446270.682985:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1789446270.683182:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1789446270.683207:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1789446270.683231:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1789446270.683239:0:25145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1789446270.683368:0:25145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08061180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794654464:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789446270.684215:0:25145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446270.684284:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794654464 00000100:00100000:3.0:1789446270.684292:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794654464 00000100:00100000:0.0:1789446270.684302:0:25145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d07f55a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789446270.684360:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789446270.684369:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+24:25145:x1876369794654464:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789446270.684493:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+24:25145:x1876369794654464:12345-0@lo:501:mount.lustre.0 Request processed in 124us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446270.684501:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789446270.686436:0:25145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08061180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794654464:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789446270.686492:0:25145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08061180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794654592:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789446270.686561:0:25145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446270.686635:0:25145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d07f55a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789446270.686746:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794654592 00000100:00100000:3.0:1789446270.686754:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794654592 00000100:00100000:3.0:1789446270.686814:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789446270.686823:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+24:25145:x1876369794654592:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789446270.686947:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+24:25145:x1876369794654592:12345-0@lo:503:mount.lustre.0 Request processed in 124us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446270.686993:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789446270.687005:0:25145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08061180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794654592:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789446270.687574:0:25145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789446270.687650:0:25145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08061180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794654720:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789446270.687699:0:25145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446270.687758:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794654720 00000100:00100000:0.0:1789446270.687934:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794654720 00000100:00100000:0.0:1789446270.687996:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789446270.688006:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+24:25145:x1876369794654720:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789446270.688115:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+24:25145:x1876369794654720:12345-0@lo:502:mount.lustre.0 Request processed in 111us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446270.688122:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789446270.688177:0:25145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d07f55a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789446270.688194:0:25145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08061180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794654720:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789446270.688750:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1789446270.688795:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1789446270.688809:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1789446270.688821:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1789446270.688834:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1789446270.688846:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1789446270.688859:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1789446270.688872:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1789446270.688895:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1789446270.688908:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1789446270.688920:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1789446270.688932:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1789446270.688942:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1789446270.688952:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1789446270.688986:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1789446270.688996:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1789446270.689006:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1789446270.689016:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1789446270.689038:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1789446270.689054:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1789446270.689064:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1789446270.689074:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1789446270.689083:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1789446270.689093:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1789446270.689102:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1789446270.689112:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1789446270.689123:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1789446270.689132:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1789446270.689154:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1789446270.689165:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1789446270.689174:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1789446270.689184:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1789446270.689194:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1789446270.689203:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1789446270.689224:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1789446270.689237:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1789446270.689247:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1789446270.689256:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1789446270.689265:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1789446270.689275:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1789446270.689284:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1789446270.689302:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1789446270.689312:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1789446270.689322:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1789446270.689332:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1789446270.689341:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1789446270.689363:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1789446270.689374:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1789446270.689423:0:25145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08061180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794654848:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789446270.689475:0:25145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446270.690314:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794654848 00000100:00100000:3.0:1789446270.690325:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794654848 00000100:00100000:3.0:1789446270.690377:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789446270.690389:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+24:25145:x1876369794654848:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789446270.690510:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+24:25145:x1876369794654848:12345-0@lo:502:mount.lustre.0 Request processed in 124us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446270.690519:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789446270.690589:0:25145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d07f55a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789446270.690610:0:25145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08061180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794654848:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789446270.691660:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1789446270.691713:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1789446270.691755:0:25145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08061180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794654976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789446270.691825:0:25145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446270.691895:0:25145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d07f55a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789446270.692020:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794654976 00000100:00100000:3.0:1789446270.692028:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794654976 00000100:00100000:3.0:1789446270.692067:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789446270.692075:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3eded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+24:25145:x1876369794654976:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789446270.692191:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3eded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+24:25145:x1876369794654976:12345-0@lo:502:mount.lustre.0 Request processed in 116us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446270.692199:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789446270.692719:0:25145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08061180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794654976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789446270.692829:0:25145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1789446270.692841:0:25145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789446270.696634:0:25158:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789446270.696650:0:25158:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c2c06b20000) 00000020:00000080:3.0:1789446270.696673:0:25158:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1789446270.696753:0:25158:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2c07a6f000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789446270.696756:0:25158:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2c07a6f000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789446270.696758:0:25158:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c2c07a6f000 3 00010000:00080000:3.0:1789446270.696794:0:25158:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2c0890b000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.148@tcp at head 00010000:00010000:3.0:1789446270.705161:0:25158:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1789446270.705895:0:25158:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789446270.705945:0:25158:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789446270.705979:0:25158:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x62554ff3745509f0 00000100:00080000:3.0:1789446270.705988:0:25158:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789446270.705998:0:25158:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2c0890b000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789446270.706030:0:25158:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2d08193100 x1876369794655104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789446270.706051:0:25158:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789446270.706297:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1876369794655104:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789446270.706371:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446270.706470:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794655104 00000100:00100000:0.0:1789446270.706477:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794655104 00000100:00100000:0.0:1789446270.706518:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789446270.706526:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1876369794655104:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789446270.706547:0:22826:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 652 last 0 00000020:00000080:0.0:1789446270.706574:0:22826:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x62554ff3745509f7 00000004:00100000:0.0:1789446270.706595:0:22826:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789446270.706622:0:22826:0:(import.c:65:import_set_state_nolock()) ffff9c2d37c08000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789446270.706678:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1876369794655104:12345-0@lo:38:llog_process_th.0 Request processed in 151us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446270.706685:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789446270.706720:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2d08193100 x1876369794655104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789446280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446270.706729:0:3656:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789446270.706737:0:3656:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1789446270.706743:0:3656:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789446270.706747:0:3656:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789446270.706749:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2c0890b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789446270.706754:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1876369794655104:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1789446270.713792:0:25158:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789446270.713810:0:25158:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9c2d35f499c0) 00000020:00000080:0.0:1789446270.713837:0:25158:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1789446270.713938:0:25158:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2c07a6f000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789446270.713943:0:25158:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2c07a6f000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789446270.713945:0:25158:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c2c07a6f000 3 00010000:00080000:0.0:1789446270.714014:0:25158:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2d37c0c000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.148@tcp at head 00010000:00010000:0.0:1789446270.719269:0:25158:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1789446270.721277:0:25158:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1789446270.721354:0:25158:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789446270.721370:0:25158:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x62554ff374550a05 00000100:00080000:0.0:1789446270.721380:0:25158:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789446270.721394:0:25158:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9c2d37c0c000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789446270.721430:0:25158:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2c08062300 x1876369794655232/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789446270.721471:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3656:1876369794655232:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789446270.721530:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446270.721808:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794655232 00000100:00100000:0.0:1789446270.721815:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794655232 00000100:00100000:0.0:1789446270.721844:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789446270.721852:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1876369794655232:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789446270.721890:0:22824:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 652 last 0 00000020:00000080:0.0:1789446270.721919:0:22824:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x62554ff374550a0c 00000004:00100000:0.0:1789446270.721932:0:22824:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789446270.721994:0:22824:0:(import.c:65:import_set_state_nolock()) ffff9c2c08909800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789446270.722049:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1876369794655232:12345-0@lo:38:llog_process_th.0 Request processed in 197us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446270.722057:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789446270.722096:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c2c08062300 x1876369794655232/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789446280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446270.722106:0:3656:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789446270.722113:0:3656:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1789446270.722120:0:3656:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789446270.722124:0:3656:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789446270.722126:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d37c0c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789446270.722131:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3656:1876369794655232:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789446270.722156:0:25158:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:0.0:1789446270.723219:0:25158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1789446270.723495:0:25145:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789446270.723537:0:25145:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789446270.723556:0:25145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c200/0x62554ff3745509db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745509e2 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.723567:0:25145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d2fa9c200/0x62554ff3745509db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff3745509e2 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789446270.723610:0:25145:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789446270.723612:0:25145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789446270.723614:0:25145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789446270.723615:0:25145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789446270.723616:0:25145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789446270.723617:0:25145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789446270.723619:0:25145:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789446270.723620:0:25145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789446270.723621:0:25145:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789446270.723624:0:25145:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789446270.723626:0:25145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789446270.723627:0:25145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789446270.723629:0:25145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789446270.723629:0:25145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789446270.723630:0:25145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789446270.723632:0:25145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789446270.723633:0:25145:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789446270.723637:0:25145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789446270.723638:0:25145:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789446270.723659:0:25145:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789446270.723675:0:25145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794655360:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789446270.723727:0:25145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446270.723754:0:25145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d08104a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789446270.723897:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794655360 00000100:00100000:0.0:1789446270.723909:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794655360 00000100:00100000:0.0:1789446270.723980:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789446270.723989:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+24:25145:x1876369794655360:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789446270.724011:0:22816:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789446270.724024:0:22816:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789446270.731767:0:22816:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789446270.731790:0:22816:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789446270.732517:0:22840:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789446270.732524:0:22840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789446270.732550:0:22840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550a13 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.732570:0:22840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2d2fa9dc00/0x62554ff3745508a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff374550899 expref: 24 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.732579:0:22840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2d36a50a00/0x62554ff3745508ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff3745508a7 expref: 24 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.732586:0:22840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550a13 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.732628:0:22840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2d36a50a00/0x62554ff3745508ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x62554ff3745508a7 expref: 24 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.732643:0:22840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2d36a50a00/0x62554ff3745508ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x62554ff3745508a7 expref: 24 pid: 22818 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446270.732657:0:22840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08062300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22840:1876369794655488:0@lo:104: 00000100:00100000:0.0:1789446270.732715:0:22840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789446270.732803:0:22840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2d2fa9dc00/0x62554ff3745508a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x62554ff374550899 expref: 24 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.732811:0:22840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2d2fa9dc00/0x62554ff3745508a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x62554ff374550899 expref: 24 pid: 22816 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446270.732832:0:22840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08060000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22840:1876369794655616:0@lo:104: 00000100:00100000:0.0:1789446270.732854:0:22840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446270.733644:0:22840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d02b49b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789446270.735271:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794655488 00000100:00100000:1.0:1789446270.735282:0:22807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794655488 00000100:00100000:0.0:1789446270.735655:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+24:25145:x1876369794655360:12345-0@lo:253:mount.lustre.0 Request processed in 11664us (11924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446270.735666:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789446270.735724:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794655616 00000100:00100000:0.0:1789446270.735727:0:22807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794655616 00000100:00100000:0.0:1789446270.735739:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789446270.735744:0:22807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:282408b2-7484-4ad3-93ba-27093493daa8+4:22840:x1876369794655488:12345-0@lo:104: 00010000:00010000:0.0:1789446270.735760:0:22807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51800/0x62554ff3745508a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff3745508ae expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.735821:0:22807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789446270.735826:0:22807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:282408b2-7484-4ad3-93ba-27093493daa8+4:22840:x1876369794655488:12345-0@lo:104: Request processed in 81us (3111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446270.735832:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789446270.735844:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789446270.735850:0:22807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08063800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:282408b2-7484-4ad3-93ba-27093493daa8+3:22840:x1876369794655616:12345-0@lo:104: 00010000:00010000:0.0:1789446270.735856:0:22807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51c00/0x62554ff374550899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff3745508a0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.735891:0:22807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789446270.735895:0:22807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08063800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:282408b2-7484-4ad3-93ba-27093493daa8+3:22840:x1876369794655616:12345-0@lo:104: Request processed in 46us (3041us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446270.735900:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789446270.735926:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789446270.735931:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51800/0x62554ff3745508a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff3745508ae expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.735938:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36a51800 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:0.0:1789446270.735941:0:22812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51800/0x62554ff3745508a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x62554ff3745508ae expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.735949:0:22812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51800/0x62554ff3745508a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x62554ff3745508ae expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789446270.735972:0:22812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51800/0x62554ff3745508a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x62554ff3745508ae expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446270.735977:0:22812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789446270.736007:0:22812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51800/0x62554ff3745508a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745508ae expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.736013:0:22812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789446270.736031:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51800/0x62554ff3745508a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745508ae expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.736037:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51800/0x62554ff3745508a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745508ae expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.736049:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446270.736052:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51c00/0x62554ff374550899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff3745508a0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.736056:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36a51c00 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:0.0:1789446270.736059:0:22812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51c00/0x62554ff374550899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x62554ff3745508a0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.736071:0:22812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51c00/0x62554ff374550899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x62554ff3745508a0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789446270.736076:0:22812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51c00/0x62554ff374550899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x62554ff3745508a0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446270.736080:0:22812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789446270.736092:0:22812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51c00/0x62554ff374550899 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745508a0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.736096:0:22812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789446270.736108:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51c00/0x62554ff374550899 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745508a0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.736114:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d36a51c00/0x62554ff374550899 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745508a0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446270.736125:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.736127:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.736128:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446270.736133:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446270.736156:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:282408b2-7484-4ad3-93ba-27093493daa8:3657:1876369794655872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789446270.736204:0:25145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:282408b2-7484-4ad3-93ba-27093493daa8:25145:1876369794655360:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789446270.736219:0:25145:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789446270.736222:0:25145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789446270.736224:0:25145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789446270.736226:0:25145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789446270.736228:0:25145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789446270.736229:0:25145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789446270.736231:0:25145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789446270.736233:0:25145:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789446270.736235:0:25145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789446270.736236:0:25145:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789446270.736251:0:25145:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789446270.736653:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446270.736742:0:22840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08062300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22840:1876369794655488:0@lo:104: 00000100:00100000:0.0:1789446270.736753:0:22840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08060000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22840:1876369794655616:0@lo:104: 00010000:00010000:0.0:1789446270.736781:0:22840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550a13 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446270.738043:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794655872 00000100:00100000:3.0:1789446270.738054:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794655872 00010000:00010000:3.0:1789446270.738083:0:22811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2d2fa9dc00/0x62554ff3745508a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff374550899 expref: 24 pid: 22816 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446270.738118:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789446270.738127:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08062d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:282408b2-7484-4ad3-93ba-27093493daa8+24:3657:x1876369794655872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789446270.738149:0:22811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789446270.738155:0:22811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2d2fa9dc00/0x62554ff3745508a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff374550899 expref: 24 pid: 22816 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.738165:0:22811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2d2fa9dc00/0x62554ff3745508a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x62554ff374550899 expref: 24 pid: 22816 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.738181:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d2fa9dc00/0x62554ff3745508a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x62554ff374550899 expref: 24 pid: 22816 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446270.738194:0:22811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789446270.738256:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08062d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:282408b2-7484-4ad3-93ba-27093493daa8+23:3657:x1876369794655872:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446270.738263:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789446270.738288:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789446270.738290:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:282408b2-7484-4ad3-93ba-27093493daa8:3657:1876369794655872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789446270.738303:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:282408b2-7484-4ad3-93ba-27093493daa8:3659:1876369794655744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789446270.738334:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446270.738420:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794655744 00000100:00100000:1.0:1789446270.738424:0:22809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794655744 00010000:00010000:1.0:1789446270.738439:0:22809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2d36a50a00/0x62554ff3745508ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff3745508a7 expref: 23 pid: 22818 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446270.738461:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789446270.738466:0:22809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d08192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:282408b2-7484-4ad3-93ba-27093493daa8+23:3659:x1876369794655744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789446270.738485:0:22809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789446270.738489:0:22809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2d36a50a00/0x62554ff3745508ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff3745508a7 expref: 23 pid: 22818 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.738499:0:22809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2d36a50a00/0x62554ff3745508ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x62554ff3745508a7 expref: 23 pid: 22818 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.738509:0:22809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d36a50a00/0x62554ff3745508ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x62554ff3745508a7 expref: 23 pid: 22818 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.738521:0:22809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550a13 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.738529:0:22809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550a13 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789446270.738543:0:22809:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008732970s 00010000:00010000:1.0:1789446270.738547:0:22809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550a13 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.738554:0:22809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550a13 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.738561:0:22809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550a13 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.738573:0:22809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550a13 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.738579:0:22809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36a51e00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:1.0:1789446270.738583:0:22809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550a13 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.738590:0:22809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550a13 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.738603:0:22809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550a13 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.738611:0:22809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789446270.738639:0:22809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d08192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:282408b2-7484-4ad3-93ba-27093493daa8+22:3659:x1876369794655744:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446270.738646:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789446270.738672:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:282408b2-7484-4ad3-93ba-27093493daa8:3659:1876369794655744:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789446270.738686:0:22840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550a13 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.738693:0:22840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550a13 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446270.738699:0:22840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550a13 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1789446270.742785:0:25145:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1789446270.747205:0:25145:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789446270.747222:0:25145:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789446270.747257:0:25145:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789446270.747307:0:25145:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789446270.747327:0:25145:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1789446270.747347:0:25145:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1789446270.748185:0:25145:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789446270.751578:0:25145:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1789446271.014651:0:23579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789446271.142176:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789446271.809298:0:25211:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789446271.810299:0:25211:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789446272.170433:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789446272.742073:0:22821:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789446272.742138:0:22821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c2d3fe3e000 from 14 10000000:01000000:0.0:1789446272.742143:0:22821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789446272.742180:0:22821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50a00/0x62554ff374550a1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446272.742190:0:22821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50a00/0x62554ff374550a1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446272.742201:0:22821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50a00/0x62554ff374550a1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446272.742240:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08060000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794656000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789446272.742304:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446272.742596:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794656000 00000100:00100000:3.0:1789446272.742605:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794656000 00000100:00100000:3.0:1789446272.742654:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789446272.742663:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+22:22821:x1876369794656000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789446272.742677:0:22818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446272.742691:0:22818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d36806600/0x62554ff374550a21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff374550a1a expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446272.742715:0:22818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d36806600/0x62554ff374550a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff374550a1a expref: 23 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446272.742726:0:22818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d36806600/0x62554ff374550a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff374550a1a expref: 23 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446272.742733:0:22818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d36806600, rc 0) 00000100:00100000:3.0:1789446272.742771:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+23:22821:x1876369794656000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446272.742777:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789446272.742844:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d086d5300 going to sleep for 11 seconds 00000100:00100000:0.0:1789446272.742865:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08060000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794656000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789446272.742879:0:22821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50a00/0x62554ff374550a1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550a21 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446272.742888:0:22821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50a00/0x62554ff374550a1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff374550a21 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446272.742941:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08060000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794656128:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789446272.743011:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446272.743051:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d086d5300 going to sleep for 11 seconds 00000100:00100000:3.0:1789446272.743194:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794656128 00000100:00100000:3.0:1789446272.743214:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794656128 00000100:00100000:3.0:1789446272.743247:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789446272.743254:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+23:22821:x1876369794656128:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789446272.743267:0:22816:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789446272.743284:0:22816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789446272.743287:0:22816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1789446272.743359:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+23:22821:x1876369794656128:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446272.743375:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789446272.743845:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08060000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794656128:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789446272.743914:0:22821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789446272.743922:0:22821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50a00/0x62554ff374550a1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550a21 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446272.743930:0:22821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50a00/0x62554ff374550a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550a21 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789446272.743938:0:22821:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789446272.743940:0:22821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c2d41bbc000 from 14 10000000:01000000:0.0:1789446272.743943:0:22821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789446272.744038:0:22821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50000/0x62554ff374550a28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446272.744045:0:22821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50000/0x62554ff374550a28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446272.744052:0:22821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50000/0x62554ff374550a28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446272.744066:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08060000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794656256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789446272.744099:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446272.744153:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d086d5300 going to sleep for 11 seconds 00000100:00100000:3.0:1789446272.744302:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794656256 00000100:00100000:3.0:1789446272.744307:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794656256 00000100:00100000:3.0:1789446272.744343:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789446272.744351:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+23:22821:x1876369794656256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789446272.744361:0:22819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446272.744373:0:22819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d36806a00/0x62554ff374550a2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff374550a28 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446272.744661:0:22819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d36806a00/0x62554ff374550a2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff374550a28 expref: 24 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446272.744671:0:22819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d36806a00/0x62554ff374550a2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff374550a28 expref: 24 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446272.744679:0:22819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d36806a00, rc 0) 00000100:00100000:3.0:1789446272.747175:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+24:22821:x1876369794656256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2813us (3063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446272.747187:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789446272.748773:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08060000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794656256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789446272.748798:0:22821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50000/0x62554ff374550a28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550a2f expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446272.748811:0:22821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50000/0x62554ff374550a28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff374550a2f expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446272.748886:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08060000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794656384:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789446272.748941:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446272.749038:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d086d5300 going to sleep for 11 seconds 00000100:00100000:1.0:1789446272.749167:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794656384 00000100:00100000:1.0:1789446272.749175:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794656384 00000100:00100000:1.0:1789446272.749234:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789446272.749242:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+24:22821:x1876369794656384:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789446272.749261:0:22818:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789446272.749279:0:22818:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789446272.749282:0:22818:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1789446272.749607:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08060000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794656384:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789446272.749666:0:22821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789446272.749674:0:22821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50000/0x62554ff374550a28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550a2f expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446272.749682:0:22821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50000/0x62554ff374550a28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550a2f expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446272.749721:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+24:22821:x1876369794656384:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 137us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446272.749730:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00010000:0.0:1789446273.191040:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446274.220416:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446274.279370:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1876369794656512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789446274.279443:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446274.279527:0:23565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794656512 00000100:00100000:0.0:1789446274.279534:0:23565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794656512 00000100:00100000:0.0:1789446274.279574:0:23565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789446274.279583:0:23565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1876369794656512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789446274.279613:0:23565:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789446274.279663:0:23565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1876369794656512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446274.279670:0:23565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789446274.279714:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1876369794656512:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789446274.279825:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789446274.279834:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1876369794656640:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789446274.279866:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446274.279892:0:24333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794656640 00000100:00100000:2.0:1789446274.279896:0:24333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794656640 00000100:00100000:2.0:1789446274.279930:0:24333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789446274.279937:0:24333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876369794656640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789446274.279972:0:24333:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789446274.280010:0:24333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876369794656640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446274.280017:0:24333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789446274.280033:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789446274.280057:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1876369794656640:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789446274.280215:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1876369794656768:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789446274.280239:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446274.280437:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794656768 00000100:00100000:1.0:1789446274.280443:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794656768 00000100:00100000:1.0:1789446274.280478:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789446274.280485:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876369794656768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789446274.280503:0:22830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789446274.280546:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1876369794656768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446274.280552:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789446274.280621:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1876369794656768:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789446275.245103:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789446275.302869:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789446275.302891:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1876369794656896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789446275.302975:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446275.303051:0:24333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794656896 00000100:00100000:1.0:1789446275.303059:0:24333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794656896 00000100:00100000:1.0:1789446275.303110:0:24333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789446275.303130:0:24333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ff47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1876369794656896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789446275.303150:0:24333:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789446275.303205:0:24333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ff47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1876369794656896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446275.303212:0:24333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789446275.303233:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789446275.303267:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1876369794656896:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789446275.814187:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1789446275.814304:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:282408b2-7484-4ad3-93ba-27093493daa8:3658:1876369794657024:0@lo:400:kworker.0 00000100:00100000:3.0:1789446275.814376:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446275.814563:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789446275.814572:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1876369794657152:0@lo:400:kworker.0 00000100:00100000:3.0:1789446275.814616:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446275.814659:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794657024 00000100:00100000:3.0:1789446275.814666:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794657024 00000100:00080000:2.0:1789446275.814771:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789446275.814775:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c2d187ae000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789446275.814786:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 652 00000100:00080000:2.0:1789446275.814790:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789446275.814798:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c2d187ae000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1789446275.814821:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2c05a7aa00 x1876369794657280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789446275.814863:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789446275.814866:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789446275.814868:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c2d3fea6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789446275.814871:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 652 00000100:00080000:2.0:1789446275.814873:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789446275.814878:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c2d3fea6800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789446275.817513:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789446275.817529:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+24:3658:x1876369794657024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446275.817601:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+24:3658:x1876369794657024:12345-0@lo:400:kworker.0 Request processed in 76us (3223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446275.817608:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789446275.818104:0:22829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794657152 00000100:00100000:3.0:1789446275.818123:0:22829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794657152 00000100:00100000:3.0:1789446275.818163:0:22829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789446275.818170:0:22829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d08190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1876369794657152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446275.818285:0:22829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d08190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1876369794657152:12345-0@lo:400:kworker.0 Request processed in 114us (3667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446275.818292:0:22829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789446275.818322:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876369794657408:0@lo:400:kworker.0 00000100:00100000:3.0:1789446275.818354:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446275.818389:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1876369794657152:0@lo:400:kworker.0 00000100:00100000:3.0:1789446275.818413:0:22825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794657408 00000100:00100000:3.0:1789446275.818416:0:22825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794657408 00000100:00100000:3.0:1789446275.818439:0:22825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789446275.818444:0:22825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d08190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876369794657408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446275.818561:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2c05a78e00 x1876369794657792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789446275.818676:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794657536:0@lo:400:kworker.0 00000100:00100000:2.0:1789446275.826306:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446275.826348:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1876369794658176:0@lo:400:kworker.0 00000100:00100000:2.0:1789446275.826382:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446275.826409:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789446275.826417:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794657664:0@lo:400:kworker.0 00000100:00100000:2.0:1789446275.826443:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446275.826475:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1876369794658304:0@lo:400:kworker.0 00000100:00100000:2.0:1789446275.826506:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446275.826531:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876369794657920:0@lo:400:kworker.0 00000100:00100000:2.0:1789446275.826552:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446275.826575:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1876369794658432:0@lo:400:kworker.0 00000100:00100000:2.0:1789446275.826595:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446275.826605:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789446275.826611:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1876369794658048:0@lo:400:kworker.0 00000100:00100000:2.0:1789446275.826628:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446275.826647:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794657280:0@lo:8:kworker.0 00000100:00100000:2.0:1789446275.826668:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446275.826682:0:3656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794657792:0@lo:8:kworker.0 00000100:00100000:2.0:1789446275.826712:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446275.826825:0:23565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794657536 00000100:00100000:2.0:1789446275.826832:0:23565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794657536 00000100:00100000:2.0:1789446275.826874:0:23565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789446275.826882:0:23565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794657536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446275.826945:0:23565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794657536:12345-0@lo:400:kworker.0 Request processed in 64us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446275.826952:0:23565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789446275.826995:0:22826:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789446275.827002:0:22826:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789446275.827026:0:24332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794657664 00000100:00100000:2.0:1789446275.827029:0:24332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794657664 00000100:00100000:2.0:1789446275.827052:0:24332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794657280 00000100:00100000:2.0:1789446275.827054:0:24332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794657280 00000100:00100000:2.0:1789446275.827061:0:24332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794657792 00000100:00100000:2.0:1789446275.827063:0:24332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794657792 00000100:00100000:2.0:1789446275.827072:0:24332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789446275.827078:0:24332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794657664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446275.827107:0:24332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794657664:12345-0@lo:400:kworker.0 Request processed in 30us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446275.827136:0:24332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789446275.827151:0:24332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789446275.827155:0:24332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3656:x1876369794657280:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789446275.827179:0:24332:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 657 last 0 00000020:00000080:2.0:1789446275.827203:0:24332:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x62554ff374550a36 00002000:00100000:2.0:1789446275.827215:0:24332:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c2c0173c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789446275.827219:0:24332:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789446275.827222:0:24332:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789446275.827364:0:24332:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789446275.827385:0:24332:0:(import.c:65:import_set_state_nolock()) ffff9c2c0173f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789446275.827421:0:24332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3656:x1876369794657280:12345-0@lo:8:kworker.0 Request processed in 264us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446275.827428:0:24332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789446275.827438:0:24332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789446275.827442:0:24332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3656:x1876369794657792:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789446275.827455:0:24332:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 657 last 0 00000020:00000080:2.0:1789446275.827470:0:24332:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x62554ff374550a3d 00002000:00100000:2.0:1789446275.827476:0:24332:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9c2c01738800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1789446275.827479:0:24332:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1789446275.827481:0:24332:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789446275.827500:0:24332:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1789446275.827512:0:24332:0:(import.c:65:import_set_state_nolock()) ffff9c2c01739800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789446275.827538:0:24332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3656:x1876369794657792:12345-0@lo:8:kworker.0 Request processed in 95us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446275.827544:0:24332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789446275.827587:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794657664:0@lo:400:kworker.0 00000100:00100000:2.0:1789446275.827598:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794657536:0@lo:400:kworker.0 00010000:00080000:2.0:1789446275.827682:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2c05a7aa00 x1876369794657280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789446300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446275.827692:0:3656:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789446275.827697:0:3656:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1789446275.827704:0:3656:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789446275.827708:0:3656:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789446275.827711:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d187ae000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789446275.827722:0:3656:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789446275.827726:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1876369794657280:0@lo:8:kworker.0 00010000:00080000:2.0:1789446275.827737:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2c05a78e00 x1876369794657792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789446300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446275.827745:0:3656:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789446275.827748:0:3656:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1789446275.827752:0:3656:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789446275.827755:0:3656:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789446275.827757:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9c2d3fea6800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789446275.827774:0:3656:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789446275.827778:0:3656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1876369794657792:0@lo:8:kworker.0 00000004:00080000:2.0:1789446275.827818:0:22851:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1789446275.827832:0:22851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07b7ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22851:1876369794658688:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789446275.827857:0:22851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446275.827874:0:22851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d2fac76c0 going to sleep for 11 seconds 00000004:00080000:2.0:1789446275.827886:0:22850:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789446275.827945:0:22850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 657901987246ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789446275.827952:0:22850:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1789446275.827992:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789446275.828000:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794658560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789446275.828027:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446275.828051:0:24332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794658688 00000100:00100000:2.0:1789446275.828055:0:24332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794658688 00000100:00100000:2.0:1789446275.828082:0:24332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789446275.828088:0:24332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22851:x1876369794658688:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789446275.828343:0:24333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794658560 00000100:00100000:2.0:1789446275.828348:0:24333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794658560 00000100:00100000:2.0:1789446275.828375:0:24333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789446275.828382:0:24333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3659:x1876369794658560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789446275.828398:0:24333:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789446275.828437:0:24333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3659:x1876369794658560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446275.828443:0:24333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789446275.828460:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789446275.828483:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2c07b79180 x1876369794658560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789446291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446275.828498:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07b79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794658560:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1789446275.828836:0:23569:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789446275.828854:0:23569:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08062a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23569:1876369794658944:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1789446275.828885:0:23569:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446275.828929:0:23569:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d35cc6b40 going to sleep for 11 seconds 00000004:00080000:0.0:1789446275.831442:0:22804:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1789446275.831775:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794658944 00000100:00100000:1.0:1789446275.831786:0:24833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794658944 00000100:00100000:1.0:1789446275.831838:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789446275.831846:0:24833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23569:x1876369794658944:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:1.0:1789446275.831914:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789446275.831940:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794658176 00000100:00100000:1.0:1789446275.831944:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794658176 00000100:00100000:1.0:1789446275.831991:0:22826:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789446275.831999:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794658304 00000100:00100000:1.0:1789446275.832001:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794658304 00000100:00100000:1.0:1789446275.832012:0:22826:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789446275.832028:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794657920 00000100:00100000:1.0:1789446275.832030:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794657920 00000100:00100000:1.0:1789446275.832040:0:22826:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789446275.832044:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794658432 00000100:00100000:1.0:1789446275.832046:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794658432 00000100:00100000:1.0:1789446275.832055:0:22826:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789446275.832059:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794658048 00000100:00100000:1.0:1789446275.832062:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794658048 00000100:00100000:1.0:1789446275.832071:0:22826:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789446275.832077:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789446275.832090:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1876369794658176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446275.832173:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1876369794658176:12345-0@lo:400:kworker.0 Request processed in 83us (5789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446275.832180:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789446275.832207:0:22826:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789446275.832213:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789446275.832219:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1876369794658304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446275.832246:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1876369794658304:12345-0@lo:400:kworker.0 Request processed in 27us (5739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446275.832250:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789446275.832259:0:22826:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789446275.832264:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789446275.832269:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876369794657920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446275.832300:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876369794657920:12345-0@lo:400:kworker.0 Request processed in 31us (5746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446275.832305:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789446275.832314:0:22826:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789446275.832319:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789446275.832324:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876369794658432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446275.832348:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876369794658432:12345-0@lo:400:kworker.0 Request processed in 24us (5752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446275.832353:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789446275.832361:0:22826:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789446275.832366:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789446275.832371:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876369794658048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446275.832394:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1876369794658048:12345-0@lo:400:kworker.0 Request processed in 23us (5765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446275.832406:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789446275.832420:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789446275.832422:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789446275.832450:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2c05a78380 x1876369794658048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789446275.832477:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1876369794658048:0@lo:400:kworker.0 00010000:00080000:1.0:1789446275.832490:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2c05a79f80 x1876369794657920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789446275.832498:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876369794657920:0@lo:400:kworker.0 00010000:00080000:1.0:1789446275.832512:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2d41b7e680 x1876369794658432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789446275.832519:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1876369794658432:0@lo:400:kworker.0 00000100:00100000:1.0:1789446275.833278:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:282408b2-7484-4ad3-93ba-27093493daa8:3658:1876369794657024:0@lo:400:kworker.0 00000100:00100000:1.0:1789446275.833294:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789446275.833303:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794658816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789446275.833354:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789446275.835779:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2d41b7ca80 x1876369794658304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446275.835797:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1876369794658304:0@lo:400:kworker.0 00010000:00080000:2.0:1789446275.835811:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2d41b7f800 x1876369794658176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446275.835837:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1876369794658176:0@lo:400:kworker.0 00000100:00100000:2.0:1789446275.835879:0:24333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794658816 00000100:00100000:2.0:1789446275.835886:0:24333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794658816 00000100:00100000:2.0:1789446275.836836:0:24333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789446275.837166:0:24333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ff45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3658:x1876369794658816:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789446275.837343:0:22825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d08190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1876369794657408:12345-0@lo:400:kworker.0 Request processed in 18896us (18987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446275.837352:0:22825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:3.0:1789446275.837390:0:23568:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789446275.837475:0:23568:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 657911517471ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789446275.837480:0:23568:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00002000:00000024:2.0:1789446275.837645:0:24333:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789446275.839599:0:24333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ff45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3658:x1876369794658816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2430us (6237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446275.839612:0:24333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789446275.842094:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2c08062300 x1876369794658816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789446291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789446275.842131:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794658816:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789446275.845228:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2c05a79180 x1876369794657408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789446275.845245:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1876369794657408:0@lo:400:kworker.0 00000004:00080000:1.0:1789446275.848644:0:23557:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:3.0:1789446275.850148:0:24332:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1789446275.850159:0:24332:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1789446275.850165:0:24332:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00010000:0.0:1789446275.878003:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789446275.878026:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000777a456c/0x62554ff374550a44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.878042:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1789446275.878054:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789446275.878060:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000777a456c/0x62554ff374550a44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.878077:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000777a456c/0x62554ff374550a44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.878087:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000777a456c/0x62554ff374550a44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.878093:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000777a456c/0x62554ff374550a44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.878108:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789446275.880183:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789446275.880205:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000777a456c/0x62554ff374550a44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.880218:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36a51600 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446275.880223:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000777a456c/0x62554ff374550a44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.880233:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000777a456c/0x62554ff374550a44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.880254:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000777a456c/0x62554ff374550a44 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.880262:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000777a456c/0x62554ff374550a44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.880285:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446275.880287:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446275.880288:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789446275.881130:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789446275.881140:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020e77196/0x62554ff374550a4b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.881154:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1789446275.881158:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789446275.881164:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020e77196/0x62554ff374550a4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.881175:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020e77196/0x62554ff374550a4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.881183:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020e77196/0x62554ff374550a4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.881400:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020e77196/0x62554ff374550a4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.881419:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789446275.881430:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446275.881435:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020e77196/0x62554ff374550a4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.881442:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36a51e00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446275.881445:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020e77196/0x62554ff374550a4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.881466:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020e77196/0x62554ff374550a4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.881480:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020e77196/0x62554ff374550a4b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.881487:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020e77196/0x62554ff374550a4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.881504:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446275.881506:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446275.881507:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789446275.882011:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789446275.882091:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000781f124a/0x62554ff374550a52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.882100:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1789446275.882103:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789446275.882108:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000781f124a/0x62554ff374550a52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.882126:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000781f124a/0x62554ff374550a52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.882134:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000781f124a/0x62554ff374550a52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.882142:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000781f124a/0x62554ff374550a52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.882158:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789446275.882168:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446275.882172:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000781f124a/0x62554ff374550a52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.882180:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36a51c00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446275.882183:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000781f124a/0x62554ff374550a52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789446275.882300:0:24833:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789446275.882312:0:24833:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789446275.882523:0:24833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23569:x1876369794658944:12345-0@lo:7:osp-pre-1-1.0 Request processed in 50606us (53566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446275.882534:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1789446275.882593:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000781f124a/0x62554ff374550a52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.882615:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000781f124a/0x62554ff374550a52 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.882622:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000781f124a/0x62554ff374550a52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.882638:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446275.882641:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446275.882643:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446275.882678:0:23569:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08062a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23569:1876369794658944:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1789446275.882692:0:23569:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789446275.882726:0:23569:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08062a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23569:1876369794659072:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789446275.882764:0:23569:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446275.882825:0:23569:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c06895cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789446275.884394:0:24330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794659072 00000100:00100000:3.0:1789446275.884407:0:24330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794659072 00000100:00100000:1.0:1789446275.884573:0:24331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789446275.884585:0:24331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23569:x1876369794659072:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789446275.884623:0:24331:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1789446275.884682:0:24331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23569:x1876369794659072:12345-0@lo:5:osp-pre-1-1.0 Request processed in 100us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446275.884689:0:24331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789446275.885568:0:23569:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08062a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23569:1876369794659072:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789446275.885583:0:23569:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789446275.885626:0:23569:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d08191180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23569:1876369794659200:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789446275.885666:0:23569:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446275.885698:0:23569:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d35dbef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789446275.885736:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794659200 00000100:00100000:1.0:1789446275.885742:0:24833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794659200 00000100:00100000:1.0:1789446275.885794:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789446275.885804:0:24833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d08192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23569:x1876369794659200:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789446275.885832:0:24833:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:1.0:1789446275.886026:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789446275.886034:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3de8800/0x62554ff374550a59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.886060:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1789446275.886064:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446275.886070:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3de8800/0x62554ff374550a59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.886084:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3de8800/0x62554ff374550a59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.886093:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3de8800/0x62554ff374550a59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.886101:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3de8800/0x62554ff374550a59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.886136:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789446275.886509:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789446275.886515:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9d418fe/0x62554ff374550a60 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.886653:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1789446275.886656:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446275.886661:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9d418fe/0x62554ff374550a60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.886670:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9d418fe/0x62554ff374550a60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.886679:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9d418fe/0x62554ff374550a60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.886686:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9d418fe/0x62554ff374550a60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.887132:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446275.887141:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3de8800/0x62554ff374550a59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.887151:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9c400 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446275.887156:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3de8800/0x62554ff374550a59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.887166:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3de8800/0x62554ff374550a59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.887558:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3de8800/0x62554ff374550a59 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.887568:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3de8800/0x62554ff374550a59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.887587:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446275.887590:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446275.887592:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446275.887614:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789446275.887625:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789446275.887630:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9d418fe/0x62554ff374550a60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.887638:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9d600 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:1.0:1789446275.887647:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9d418fe/0x62554ff374550a60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.887656:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9d418fe/0x62554ff374550a60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.887668:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9d418fe/0x62554ff374550a60 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.887675:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9d418fe/0x62554ff374550a60 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.887689:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446275.887691:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446275.887693:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789446275.888294:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789446275.888302:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000544b4447/0x62554ff374550a67 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.888313:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1789446275.888375:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446275.888384:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000544b4447/0x62554ff374550a67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.888397:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000544b4447/0x62554ff374550a67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.888589:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000544b4447/0x62554ff374550a67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.888605:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000544b4447/0x62554ff374550a67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.888620:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789446275.888634:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789446275.888642:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000544b4447/0x62554ff374550a67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.888651:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9c000 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446275.888654:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000544b4447/0x62554ff374550a67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.888663:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000544b4447/0x62554ff374550a67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.888676:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000544b4447/0x62554ff374550a67 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.888684:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000544b4447/0x62554ff374550a67 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.888713:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446275.888714:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446275.888716:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789446275.888988:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789446275.888995:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df3b12d7/0x62554ff374550a6e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.889003:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1789446275.889007:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446275.889012:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df3b12d7/0x62554ff374550a6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.889021:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df3b12d7/0x62554ff374550a6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.889030:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df3b12d7/0x62554ff374550a6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.889105:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df3b12d7/0x62554ff374550a6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.889135:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789446275.889155:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789446275.889162:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df3b12d7/0x62554ff374550a6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.889170:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9c600 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446275.889174:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df3b12d7/0x62554ff374550a6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.889185:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df3b12d7/0x62554ff374550a6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.889277:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df3b12d7/0x62554ff374550a6e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.889285:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df3b12d7/0x62554ff374550a6e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.889300:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446275.889302:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446275.889304:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789446275.889397:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789446275.889403:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550a75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.889416:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1789446275.889420:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446275.889423:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550a75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.889433:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550a75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.889441:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550a75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.889449:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550a75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.889637:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789446275.889936:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789446275.889942:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008407141a/0x62554ff374550a7c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.889951:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1789446275.889953:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446275.889977:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008407141a/0x62554ff374550a7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.889987:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008407141a/0x62554ff374550a7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.890007:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008407141a/0x62554ff374550a7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.890014:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008407141a/0x62554ff374550a7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.890026:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789446275.890393:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789446275.890399:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c341fc89/0x62554ff374550a83 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.890406:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1789446275.890410:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446275.890413:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c341fc89/0x62554ff374550a83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.890422:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c341fc89/0x62554ff374550a83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.890430:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c341fc89/0x62554ff374550a83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.890438:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c341fc89/0x62554ff374550a83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.890455:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1789446275.890822:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789446275.890828:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9a029d8/0x62554ff374550a8a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.890836:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1789446275.890839:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446275.890842:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9a029d8/0x62554ff374550a8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.890851:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9a029d8/0x62554ff374550a8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.890859:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9a029d8/0x62554ff374550a8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.890867:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9a029d8/0x62554ff374550a8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.890875:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1789446275.891000:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789446275.891007:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550a75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.891170:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9ca00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446275.891174:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550a75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.891184:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550a75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789446275.891239:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789446275.891245:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d663376c/0x62554ff374550a91 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.891254:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1789446275.891263:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446275.891269:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d663376c/0x62554ff374550a91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.891270:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550a75 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.891287:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550a75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.891288:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d663376c/0x62554ff374550a91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.891309:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d663376c/0x62554ff374550a91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.891316:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d663376c/0x62554ff374550a91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.891318:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789446275.891323:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008407141a/0x62554ff374550a7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.891335:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9cc00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446275.891339:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008407141a/0x62554ff374550a7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.891342:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789446275.891351:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008407141a/0x62554ff374550a7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.891362:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008407141a/0x62554ff374550a7c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.891376:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008407141a/0x62554ff374550a7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.891389:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789446275.891393:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c341fc89/0x62554ff374550a83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.891398:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9de00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446275.891401:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c341fc89/0x62554ff374550a83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.891408:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c341fc89/0x62554ff374550a83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.891416:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c341fc89/0x62554ff374550a83 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.891423:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c341fc89/0x62554ff374550a83 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.891435:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789446275.891437:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9a029d8/0x62554ff374550a8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.891443:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9dc00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446275.891451:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9a029d8/0x62554ff374550a8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789446275.891688:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789446275.891695:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2df1eae/0x62554ff374550a98 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.891704:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1789446275.891707:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446275.891712:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2df1eae/0x62554ff374550a98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.891720:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2df1eae/0x62554ff374550a98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.891728:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2df1eae/0x62554ff374550a98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.891742:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2df1eae/0x62554ff374550a98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.891825:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789446275.891977:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9a029d8/0x62554ff374550a8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.891992:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9a029d8/0x62554ff374550a8a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.891999:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9a029d8/0x62554ff374550a8a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.892079:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789446275.892085:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d663376c/0x62554ff374550a91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.892092:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9c800 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446275.892095:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d663376c/0x62554ff374550a91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.892102:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d663376c/0x62554ff374550a91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.892123:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d663376c/0x62554ff374550a91 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.892129:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d663376c/0x62554ff374550a91 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.892153:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789446275.892156:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2df1eae/0x62554ff374550a98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.892163:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9d000 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446275.892167:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2df1eae/0x62554ff374550a98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.892176:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2df1eae/0x62554ff374550a98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.892187:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2df1eae/0x62554ff374550a98 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789446275.892204:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789446275.892210:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac77846/0x62554ff374550a9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.892218:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1789446275.892222:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446275.892226:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac77846/0x62554ff374550a9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.892235:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ac77846/0x62554ff374550a9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.892243:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac77846/0x62554ff374550a9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.892249:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ac77846/0x62554ff374550a9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.892257:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789446275.892533:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2df1eae/0x62554ff374550a98 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.892547:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789446275.892550:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ac77846/0x62554ff374550a9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.892556:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9d800 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446275.892559:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac77846/0x62554ff374550a9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.892576:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac77846/0x62554ff374550a9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.892586:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ac77846/0x62554ff374550a9f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.892593:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ac77846/0x62554ff374550a9f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.892607:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446275.892609:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446275.892611:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789446275.892612:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789446275.892619:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446275.892620:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009818ae81/0x62554ff374550aa6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.892636:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1789446275.892639:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446275.892643:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009818ae81/0x62554ff374550aa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.892652:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009818ae81/0x62554ff374550aa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.892661:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009818ae81/0x62554ff374550aa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.892669:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009818ae81/0x62554ff374550aa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446275.892685:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789446275.892702:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789446275.892707:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009818ae81/0x62554ff374550aa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.892715:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9ce00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446275.892718:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009818ae81/0x62554ff374550aa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.892726:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009818ae81/0x62554ff374550aa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.892737:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009818ae81/0x62554ff374550aa6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.892752:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009818ae81/0x62554ff374550aa6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.892766:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446275.892768:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446275.892769:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789446275.893319:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789446275.893327:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020e77196/0x62554ff374550aad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.893336:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1789446275.893340:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789446275.893345:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020e77196/0x62554ff374550aad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.893356:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020e77196/0x62554ff374550aad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.893364:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020e77196/0x62554ff374550aad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.893371:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020e77196/0x62554ff374550aad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.893407:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789446275.893546:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789446275.893553:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020e77196/0x62554ff374550aad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.893561:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36a51e00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:2.0:1789446275.893565:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020e77196/0x62554ff374550aad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.893572:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020e77196/0x62554ff374550aad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.893586:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020e77196/0x62554ff374550aad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.893593:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020e77196/0x62554ff374550aad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.893619:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446275.893621:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446275.893622:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789446275.895877:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789446275.895887:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079f2b861/0x62554ff374550ab4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.895902:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1789446275.895906:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446275.895912:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079f2b861/0x62554ff374550ab4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.895926:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079f2b861/0x62554ff374550ab4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.895936:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079f2b861/0x62554ff374550ab4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.895943:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079f2b861/0x62554ff374550ab4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.895980:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789446275.897669:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789446275.897681:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f24ac13/0x62554ff374550abb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.897706:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1789446275.897710:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446275.897715:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f24ac13/0x62554ff374550abb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.897728:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f24ac13/0x62554ff374550abb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.897738:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f24ac13/0x62554ff374550abb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.897745:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f24ac13/0x62554ff374550abb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.897761:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789446275.897771:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789446275.897777:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079f2b861/0x62554ff374550ab4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.897785:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d13ba6c00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:2.0:1789446275.897789:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079f2b861/0x62554ff374550ab4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.897798:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079f2b861/0x62554ff374550ab4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.897824:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079f2b861/0x62554ff374550ab4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.897832:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079f2b861/0x62554ff374550ab4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.897850:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789446275.897853:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f24ac13/0x62554ff374550abb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.897860:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d13ba6a00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:2.0:1789446275.897863:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f24ac13/0x62554ff374550abb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.897871:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f24ac13/0x62554ff374550abb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.897880:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f24ac13/0x62554ff374550abb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.897886:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f24ac13/0x62554ff374550abb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.897897:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446275.897899:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446275.897906:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789446275.899046:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789446275.899056:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf5f584e/0x62554ff374550ac2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.899067:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1789446275.899071:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446275.899076:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf5f584e/0x62554ff374550ac2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.899087:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf5f584e/0x62554ff374550ac2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.899095:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf5f584e/0x62554ff374550ac2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.899102:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf5f584e/0x62554ff374550ac2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.899129:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789446275.899601:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789446275.899608:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000412f1016/0x62554ff374550ac9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.899616:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1789446275.899620:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446275.899624:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000412f1016/0x62554ff374550ac9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.899647:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000412f1016/0x62554ff374550ac9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.899655:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000412f1016/0x62554ff374550ac9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.899661:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000412f1016/0x62554ff374550ac9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.899669:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789446275.899942:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789446275.899948:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c85e6be/0x62554ff374550ad0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.899977:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1789446275.899981:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446275.899985:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c85e6be/0x62554ff374550ad0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.900304:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c85e6be/0x62554ff374550ad0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.900313:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c85e6be/0x62554ff374550ad0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.900530:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c85e6be/0x62554ff374550ad0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.900540:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1789446275.900836:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789446275.900842:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000771d6fcd/0x62554ff374550ad7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.900851:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1789446275.900854:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446275.900859:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000771d6fcd/0x62554ff374550ad7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.900868:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000771d6fcd/0x62554ff374550ad7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.900876:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000771d6fcd/0x62554ff374550ad7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.900883:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000771d6fcd/0x62554ff374550ad7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.900892:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1789446275.901263:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789446275.901271:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf5f584e/0x62554ff374550ac2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.901278:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d13ba7000 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446275.901282:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf5f584e/0x62554ff374550ac2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.901290:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf5f584e/0x62554ff374550ac2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.901305:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf5f584e/0x62554ff374550ac2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.901312:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf5f584e/0x62554ff374550ac2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.901343:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789446275.901348:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000412f1016/0x62554ff374550ac9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.901355:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d13ba6400 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446275.901358:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000412f1016/0x62554ff374550ac9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.901377:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000412f1016/0x62554ff374550ac9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.901388:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000412f1016/0x62554ff374550ac9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.901395:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000412f1016/0x62554ff374550ac9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.901410:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789446275.901412:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c85e6be/0x62554ff374550ad0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.901419:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d13ba6000 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446275.901422:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c85e6be/0x62554ff374550ad0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.901429:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c85e6be/0x62554ff374550ad0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.901437:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c85e6be/0x62554ff374550ad0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.901444:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c85e6be/0x62554ff374550ad0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.901646:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446275.901650:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000771d6fcd/0x62554ff374550ad7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.901656:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d13ba6200 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446275.901659:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000771d6fcd/0x62554ff374550ad7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.901667:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000771d6fcd/0x62554ff374550ad7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.901677:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000771d6fcd/0x62554ff374550ad7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.901684:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000771d6fcd/0x62554ff374550ad7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.901695:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446275.901697:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446275.901698:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789446275.902161:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789446275.902168:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009745c4f3/0x62554ff374550ade lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.902184:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1789446275.902608:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446275.902615:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009745c4f3/0x62554ff374550ade lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.902627:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009745c4f3/0x62554ff374550ade lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.902636:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009745c4f3/0x62554ff374550ade lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.902642:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009745c4f3/0x62554ff374550ade lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.902659:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789446275.902893:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446275.902900:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009745c4f3/0x62554ff374550ade lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.902907:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d13ba7c00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446275.902916:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009745c4f3/0x62554ff374550ade lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.902925:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009745c4f3/0x62554ff374550ade lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.902938:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009745c4f3/0x62554ff374550ade lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.902944:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009745c4f3/0x62554ff374550ade lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.902978:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446275.902980:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446275.902982:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789446275.903154:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789446275.903159:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000556c5610/0x62554ff374550ae5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.903167:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1789446275.903170:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446275.903173:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000556c5610/0x62554ff374550ae5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.903181:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000556c5610/0x62554ff374550ae5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.903703:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000556c5610/0x62554ff374550ae5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.903711:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000556c5610/0x62554ff374550ae5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.903727:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789446275.903916:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446275.903922:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000556c5610/0x62554ff374550ae5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.903929:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d13ba7a00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446275.903933:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000556c5610/0x62554ff374550ae5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.903941:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000556c5610/0x62554ff374550ae5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.903983:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000556c5610/0x62554ff374550ae5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.903997:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000556c5610/0x62554ff374550ae5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.904394:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789446275.904581:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789446275.904587:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081b7e5c2/0x62554ff374550aec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.904598:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1789446275.904601:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446275.904606:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081b7e5c2/0x62554ff374550aec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.904615:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081b7e5c2/0x62554ff374550aec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.904623:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081b7e5c2/0x62554ff374550aec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446275.904630:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081b7e5c2/0x62554ff374550aec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.905099:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446275.905221:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446275.905225:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446275.905400:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789446275.909395:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789446275.909406:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081b7e5c2/0x62554ff374550aec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.909419:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d13ba6e00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446275.909425:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081b7e5c2/0x62554ff374550aec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.909436:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081b7e5c2/0x62554ff374550aec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.909787:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081b7e5c2/0x62554ff374550aec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.909798:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081b7e5c2/0x62554ff374550aec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.909820:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446275.909822:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446275.909829:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789446275.912783:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789446275.912796:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ad2e9ef/0x62554ff374550af3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.912811:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=657s v=(0 0) 00010000:00010000:3.0:1789446275.912815:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789446275.912822:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ad2e9ef/0x62554ff374550af3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.912836:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ad2e9ef/0x62554ff374550af3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.912846:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ad2e9ef/0x62554ff374550af3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.912854:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ad2e9ef/0x62554ff374550af3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.912878:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789446275.913648:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446275.913657:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ad2e9ef/0x62554ff374550af3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.913668:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36807e00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446275.913672:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ad2e9ef/0x62554ff374550af3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.913682:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ad2e9ef/0x62554ff374550af3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.913699:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ad2e9ef/0x62554ff374550af3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.913707:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ad2e9ef/0x62554ff374550af3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.913724:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446275.913726:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446275.913727:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789446275.914180:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789446275.914374:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000832795b2/0x62554ff374550afa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.914387:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=657s v=(0 0) 00010000:00010000:3.0:1789446275.914391:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789446275.914397:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000832795b2/0x62554ff374550afa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.914419:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000832795b2/0x62554ff374550afa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.914429:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000832795b2/0x62554ff374550afa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.914437:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000832795b2/0x62554ff374550afa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.915009:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789446275.915091:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789446275.915097:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000832795b2/0x62554ff374550afa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.915106:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36807a00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446275.915573:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000832795b2/0x62554ff374550afa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.915586:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000832795b2/0x62554ff374550afa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.915604:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000832795b2/0x62554ff374550afa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.915611:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000832795b2/0x62554ff374550afa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.915637:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446275.915639:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446275.915641:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789446275.917574:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789446275.917584:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fb9c354/0x62554ff374550b01 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.917599:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=657s v=(0 0) 00010000:00010000:3.0:1789446275.917603:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789446275.917608:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fb9c354/0x62554ff374550b01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.917621:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fb9c354/0x62554ff374550b01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.917630:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fb9c354/0x62554ff374550b01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.917636:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fb9c354/0x62554ff374550b01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.917659:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789446275.917809:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446275.917817:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fb9c354/0x62554ff374550b01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.917826:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36806200 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446275.917830:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fb9c354/0x62554ff374550b01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.917840:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fb9c354/0x62554ff374550b01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.917857:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fb9c354/0x62554ff374550b01 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.917864:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fb9c354/0x62554ff374550b01 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.917883:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446275.917885:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446275.917887:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789446275.919471:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789446275.919482:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000781f124a/0x62554ff374550b08 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.919495:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1789446275.919499:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789446275.919504:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000781f124a/0x62554ff374550b08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.919527:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000781f124a/0x62554ff374550b08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.919537:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000781f124a/0x62554ff374550b08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.919544:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000781f124a/0x62554ff374550b08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.919559:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789446275.920295:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789446275.920303:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000781f124a/0x62554ff374550b08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.920379:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36a51c00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446275.920383:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000781f124a/0x62554ff374550b08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.920392:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000781f124a/0x62554ff374550b08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.920408:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000781f124a/0x62554ff374550b08 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.920414:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000781f124a/0x62554ff374550b08 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.920431:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446275.920435:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446275.920436:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789446275.920777:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789446275.920784:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7381c02/0x62554ff374550b0f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.920793:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1789446275.920796:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789446275.920801:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7381c02/0x62554ff374550b0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.920811:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7381c02/0x62554ff374550b0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.920820:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7381c02/0x62554ff374550b0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.920838:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7381c02/0x62554ff374550b0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.920856:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789446275.920865:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789446275.920869:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7381c02/0x62554ff374550b0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.920876:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36a51800 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:0.0:1789446275.920879:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7381c02/0x62554ff374550b0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.920886:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7381c02/0x62554ff374550b0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.920897:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7381c02/0x62554ff374550b0f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.920904:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7381c02/0x62554ff374550b0f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.920917:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446275.920919:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789446275.920920:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789446275.926075:0:25146:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1789446275.926135:0:25146:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1789446275.926140:0:25146:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789446275.926576:0:24833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d08192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23569:x1876369794659200:12345-0@lo:5:osp-pre-1-1.0 Request processed in 40768us (40904us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1789446275.926586:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789446275.926849:0:23569:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1789446275.926857:0:23569:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d08191180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23569:1876369794659200:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789446275.926871:0:23569:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1789446275.926923:0:23569:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07b79180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23569:1876369794659328:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789446275.927007:0:23569:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446275.927404:0:23569:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d20653840 going to sleep for 11 seconds 00000100:00100000:3.0:1789446275.927521:0:22835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794659328 00000100:00100000:3.0:1789446275.927528:0:22835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794659328 00000100:00100000:3.0:1789446275.927576:0:22835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789446275.927586:0:22835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23569:x1876369794659328:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789446275.927646:0:22835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23569:x1876369794659328:12345-0@lo:900:osp-pre-1-1.0 Request processed in 61us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446275.927654:0:22835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789446275.927717:0:23569:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2c07b79180 x1876369794659328/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789446291 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446275.927729:0:23569:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07b79180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23569:1876369794659328:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1789446275.927934:0:24332:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789446275.927950:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fc9f124/0x62554ff374550b16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.927991:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=658s v=(0 0) 00010000:00010000:0.0:1789446275.927995:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789446275.928001:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fc9f124/0x62554ff374550b16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.928028:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fc9f124/0x62554ff374550b16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.928039:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fc9f124/0x62554ff374550b16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.928047:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fc9f124/0x62554ff374550b16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446275.928066:0:24332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789446275.928152:0:24332:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:0.0:1789446275.928242:0:24332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22851:x1876369794658688:12345-0@lo:5:osp-pre-1-0.0 Request processed in 100153us (100383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446275.928250:0:24332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1789446275.929702:0:22812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789446275.929712:0:22812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fc9f124/0x62554ff374550b16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.929726:0:22812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36a51400 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446275.929731:0:22812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fc9f124/0x62554ff374550b16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.929742:0:22812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fc9f124/0x62554ff374550b16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.929760:0:22812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fc9f124/0x62554ff374550b16 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.929768:0:22812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fc9f124/0x62554ff374550b16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446275.929791:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446275.929793:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446275.929795:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446275.929900:0:22851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07b7ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22851:1876369794658688:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789446275.929915:0:22851:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1789446275.929996:0:22851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07b7ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22851:1876369794659456:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789446275.930051:0:22851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446275.930078:0:22851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d20653840 going to sleep for 11 seconds 00000100:00100000:0.0:1789446275.930539:0:24330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794659456 00000100:00100000:0.0:1789446275.930545:0:24330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794659456 00000100:00100000:0.0:1789446275.930597:0:24330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789446275.930605:0:24330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22851:x1876369794659456:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1789446275.930640:0:24330:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:0.0:1789446275.937803:0:24330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22851:x1876369794659456:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7193us (7746us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1789446275.937815:0:24330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789446275.938278:0:22851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07b7ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22851:1876369794659456:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789446275.938294:0:22851:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:0.0:1789446276.275118:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789446276.597710:0:22862:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789446277.287057:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789446277.600029:0:25503:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789446278.311428:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789446278.688544:0:25555:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789446278.688775:0:25555:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789446279.335826:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446279.398282:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789446279.398372:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794659584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789446279.398445:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446279.398783:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794659712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789446279.398830:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446279.398905:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794659712 00000100:00100000:0.0:1789446279.398911:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794659712 00000100:00100000:0.0:1789446279.398993:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789446279.399483:0:24333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794659584 00000100:00100000:2.0:1789446279.399488:0:24333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794659584 00000100:00100000:0.0:1789446279.399674:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794659712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789446279.399725:0:22830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789446279.399794:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794659712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 792us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446279.399801:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789446279.399835:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3ff47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1876369794659840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789446279.399864:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446279.399921:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794659712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789446279.400742:0:24333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789446279.400754:0:24333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794659584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789446279.400780:0:24333:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789446279.400839:0:24333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794659584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (2393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446279.400846:0:24333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1789446279.400936:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789446279.400954:0:22829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794659840 00000100:00100000:3.0:1789446279.400994:0:22829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794659840 00000100:00100000:3.0:1789446279.401040:0:22829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789446279.401047:0:22829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1876369794659840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789446279.401067:0:22829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789446279.401118:0:22829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1876369794659840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446279.401124:0:22829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789446279.401390:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3ff47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1876369794659840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789446279.401415:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07b79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794659584:0@lo:13:osp-pre-0-1.0 00000020:00000004:2.0:1789446279.604507:0:25605:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789446279.604795:0:25605:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789446279.940465:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446279.941420:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773574784 00000100:00100000:0.0:1789446279.941431:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773574784 00000100:00100000:0.0:1789446279.941782:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 114 00000100:00100000:0.0:1789446279.941791:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2403:x1876369773574784:12345-192.168.206.48@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789446279.941819:0:22816:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from ae38b160-8985-48da-9d2d-8e0f9518970b@192.168.206.48@tcp t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:0.0:1789446279.941848:0:22816:0:(genops.c:1384:class_connect()) connect: client ae38b160-8985-48da-9d2d-8e0f9518970b, cookie 0x62554ff374550b1d 00000100:00080000:0.0:1789446279.942495:0:22816:0:(import.c:65:import_set_state_nolock()) ffff9c2c0890a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789446279.942577:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+5:2403:x1876369773574784:12345-192.168.206.48@tcp:250:mount.lustre.0 Request processed in 784us (2119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446279.942585:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 114 00000100:00100000:3.0:1789446279.948788:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446279.949355:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773574912 00000100:00100000:0.0:1789446279.949366:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773574912 00000100:00100000:0.0:1789446279.949716:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 115 00000100:00100000:0.0:1789446279.949726:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+5:18080:x1876369773574912:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789446279.949742:0:22816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789446279.949762:0:22816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d36a51400/0x62554ff374550b24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a65399 expref: -99 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446279.949790:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d36a51400/0x62554ff374550b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65399 expref: 6 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446279.949802:0:22816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d36a51400/0x62554ff374550b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65399 expref: 6 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446279.949810:0:22816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d36a51400, rc 0) 00000100:00100000:0.0:1789446279.949876:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+6:18080:x1876369773574912:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 151us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446279.949882:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 115 00000100:00100000:1.0:1789446279.956781:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446279.958426:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773575040 00000100:00100000:0.0:1789446279.958439:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773575040 00000100:00100000:0.0:1789446279.958514:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 116 00000100:00100000:0.0:1789446279.958534:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+6:18080:x1876369773575040:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789446279.958655:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+6:18080:x1876369773575040:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 122us (1882us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789446279.958676:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 116 00000100:00100000:1.0:1789446279.982625:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446279.982712:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773575168 00000100:00100000:3.0:1789446279.982721:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773575168 00000100:00100000:3.0:1789446279.982773:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 117 00000100:00100000:3.0:1789446279.982783:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3eded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+6:18080:x1876369773575168:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789446279.982798:0:22819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446279.982812:0:22819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d36807a00/0x62554ff374550b2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a653a0 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446279.982839:0:22819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d36807a00/0x62554ff374550b2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a653a0 expref: 7 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446279.982851:0:22819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d36807a00/0x62554ff374550b2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a653a0 expref: 7 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446279.982859:0:22819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d36807a00, rc 0) 00000100:00100000:3.0:1789446279.982915:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3eded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+7:18080:x1876369773575168:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 132us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446279.982921:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 117 00000100:00100000:3.0:1789446279.997329:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446279.997587:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773575296 00000100:00100000:2.0:1789446279.997597:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773575296 00000100:00100000:2.0:1789446279.997650:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 118 00000100:00100000:2.0:1789446279.997659:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae38b160-8985-48da-9d2d-8e0f9518970b+7:18080:x1876369773575296:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789446279.997810:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae38b160-8985-48da-9d2d-8e0f9518970b+8:18080:x1876369773575296:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 151us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446279.997818:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 118 00000100:00100000:1.0:1789446280.012601:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446280.013005:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773575424 00000100:00100000:0.0:1789446280.013014:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773575424 00000100:00100000:0.0:1789446280.013068:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 119 00000100:00100000:0.0:1789446280.013078:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+8:18080:x1876369773575424:12345-192.168.206.48@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789446280.013225:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+8:18080:x1876369773575424:12345-192.168.206.48@tcp:503:mount.lustre.0 Request processed in 148us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446280.013233:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 119 00000100:00100000:1.0:1789446280.021117:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446280.021545:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773575552 00000100:00100000:3.0:1789446280.021572:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773575552 00000100:00100000:3.0:1789446280.021641:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 120 00000100:00100000:3.0:1789446280.021656:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+8:18098:x1876369773575552:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789446280.021831:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+8:18098:x1876369773575552:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 178us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446280.021839:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 120 00000100:00100000:3.0:1789446280.058491:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446280.058684:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773575680 00000100:00100000:2.0:1789446280.058694:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773575680 00000100:00100000:2.0:1789446280.058748:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 121 00000100:00100000:2.0:1789446280.058758:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ededc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae38b160-8985-48da-9d2d-8e0f9518970b+8:18098:x1876369773575680:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789446280.058908:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ededc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae38b160-8985-48da-9d2d-8e0f9518970b+8:18098:x1876369773575680:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 150us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446280.058915:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 121 00000100:00100000:2.0:1789446280.070385:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446280.070712:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773575808 00000100:00100000:1.0:1789446280.070721:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773575808 00000100:00100000:1.0:1789446280.070787:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 122 00000100:00100000:1.0:1789446280.070796:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d04a52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+8:18098:x1876369773575808:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789446280.075766:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d04a52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+8:18098:x1876369773575808:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 4958us (5377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446280.075782:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 122 00000100:00100000:1.0:1789446280.079743:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446280.080658:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773575936 00000100:00100000:3.0:1789446280.080675:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773575936 00000100:00100000:3.0:1789446280.080764:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 123 00000100:00100000:3.0:1789446280.080777:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d04a51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+8:18080:x1876369773575936:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789446280.080799:0:22819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446280.080822:0:22819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d36807200/0x62554ff374550b32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a653d1 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446280.080859:0:22819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d36807200/0x62554ff374550b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a653d1 expref: 9 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446280.080872:0:22819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d36807200/0x62554ff374550b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a653d1 expref: 9 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446280.080882:0:22819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d36807200, rc 0) 00000100:00100000:3.0:1789446280.081003:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d04a51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+9:18080:x1876369773575936:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 228us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446280.081011:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 123 00000100:00100000:3.0:1789446280.089314:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446280.089420:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773576064 00000100:00100000:0.0:1789446280.089430:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773576064 00000100:00100000:0.0:1789446280.089519:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 124 00000100:00100000:0.0:1789446280.089529:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d04a53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+9:18080:x1876369773576064:12345-192.168.206.48@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789446280.089553:0:22816:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789446280.089588:0:22816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789446280.089593:0:22816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789446280.089596:0:22816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789446280.089610:0:22816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789446280.089613:0:22816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1789446280.095209:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d04a53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+9:18080:x1876369773576064:12345-192.168.206.48@tcp:256:mount.lustre.0 Request processed in 5673us (5906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446280.095223:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 124 00000100:00100000:1.0:1789446280.105729:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446280.105868:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773576192 00000100:00100000:2.0:1789446280.105877:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773576192 00000100:00100000:2.0:1789446280.105930:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 125 00000100:00100000:2.0:1789446280.105946:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d04a51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae38b160-8985-48da-9d2d-8e0f9518970b+9:18080:x1876369773576192:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789446280.105987:0:22818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789446280.106005:0:22818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d13ba7600/0x62554ff374550b39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a653d8 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446280.106042:0:22818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d13ba7600/0x62554ff374550b39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a653d8 expref: 10 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446280.106054:0:22818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d13ba7600/0x62554ff374550b39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a653d8 expref: 10 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446280.106063:0:22818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d13ba7600, rc 0) 00000100:00100000:2.0:1789446280.106362:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d04a51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae38b160-8985-48da-9d2d-8e0f9518970b+10:18080:x1876369773576192:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 422us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446280.106371:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 125 00000100:00100000:3.0:1789446280.118785:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446280.119679:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773576320 00000100:00100000:0.0:1789446280.119698:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773576320 00000100:00100000:0.0:1789446280.119764:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 126 00000100:00100000:0.0:1789446280.119775:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d07223050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+10:18080:x1876369773576320:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789446280.120034:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d07223050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+10:18080:x1876369773576320:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 260us (2598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446280.120043:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 126 00000100:00100000:1.0:1789446280.124491:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446280.125056:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773576448 00000100:00100000:2.0:1789446280.125066:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773576448 00000100:00100000:2.0:1789446280.125131:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 127 00000100:00100000:2.0:1789446280.125142:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d07220050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae38b160-8985-48da-9d2d-8e0f9518970b+10:18080:x1876369773576448:12345-192.168.206.48@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789446280.125472:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d07220050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae38b160-8985-48da-9d2d-8e0f9518970b+10:18080:x1876369773576448:12345-192.168.206.48@tcp:503:mount.lustre.0 Request processed in 323us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446280.125480:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 127 00000100:00100000:1.0:1789446280.136927:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446280.139917:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773576576 00000100:00100000:3.0:1789446280.139930:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773576576 00000100:00100000:3.0:1789446280.140076:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 128 00000100:00100000:3.0:1789446280.140088:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+10:18103:x1876369773576576:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789446280.140263:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+10:18103:x1876369773576576:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 177us (3343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446280.140271:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 128 00000100:00100000:2.0:1789446280.146202:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446280.146476:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773576704 00000100:00100000:0.0:1789446280.146486:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773576704 00000100:00100000:0.0:1789446280.146575:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 129 00000100:00100000:0.0:1789446280.146585:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+10:18103:x1876369773576704:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789446280.146731:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+10:18103:x1876369773576704:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 147us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446280.146739:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 129 00000100:00100000:1.0:1789446280.152793:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446280.152835:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446280.153184:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773576832 00000100:00100000:3.0:1789446280.153193:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773576832 00000100:00100000:3.0:1789446280.153238:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773577088 00000100:00100000:3.0:1789446280.153241:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773577088 00000100:00100000:3.0:1789446280.153270:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:3.0:1789446280.153276:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ff44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1876369773576832:12345-192.168.206.48@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789446280.153314:0:25435:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from a97a55b2-7974-4297-b5cb-8884d980fe73@192.168.206.48@tcp t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:3.0:1789446280.153369:0:25435:0:(genops.c:1384:class_connect()) connect: client a97a55b2-7974-4297-b5cb-8884d980fe73, cookie 0x62554ff374550b40 00000004:00100000:3.0:1789446280.153390:0:25435:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789446280.153612:0:25435:0:(import.c:65:import_set_state_nolock()) ffff9c2d37bc1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789446280.153671:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ff44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+6:2403:x1876369773576832:12345-192.168.206.48@tcp:38:mount.lustre.0 Request processed in 393us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446280.153678:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:3.0:1789446280.153696:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:3.0:1789446280.153701:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ff44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1876369773577088:12345-192.168.206.48@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789446280.153716:0:25435:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from a97a55b2-7974-4297-b5cb-8884d980fe73@192.168.206.48@tcp t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:3.0:1789446280.153761:0:25435:0:(genops.c:1384:class_connect()) connect: client a97a55b2-7974-4297-b5cb-8884d980fe73, cookie 0x62554ff374550b47 00000004:00100000:3.0:1789446280.153773:0:25435:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789446280.153895:0:25435:0:(import.c:65:import_set_state_nolock()) ffff9c2d37bc7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789446280.153919:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ff44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+6:2403:x1876369773577088:12345-192.168.206.48@tcp:38:mount.lustre.0 Request processed in 217us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446280.153926:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:1.0:1789446280.162171:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446280.162206:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446280.162240:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446280.162317:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773577344 00000100:00100000:3.0:1789446280.162325:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773577344 00000100:00100000:3.0:1789446280.162384:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773577216 00000100:00100000:3.0:1789446280.162387:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773577216 00000100:00100000:3.0:1789446280.162402:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773576960 00000100:00100000:3.0:1789446280.162405:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773576960 00000100:00100000:3.0:1789446280.162419:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:3.0:1789446280.162428:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ff44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+7:18080:x1876369773577344:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789446280.162463:0:25435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789446280.162545:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ff44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+7:18080:x1876369773577344:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 118us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446280.162552:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:3.0:1789446280.162570:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:3.0:1789446280.162578:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ff45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+6:0:x1876369773577216:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789446280.162615:0:25435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789446280.162654:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ff45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+6:0:x1876369773577216:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 77us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446280.162660:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:3.0:1789446280.162673:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:3.0:1789446280.162679:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ff45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+6:0:x1876369773576960:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789446280.162689:0:25435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789446280.162710:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ff45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+6:0:x1876369773576960:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 32us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446280.162724:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00080000:1.0:1789446280.162788:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789446280.162792:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789446280.172149:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446280.172241:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773577472 00000100:00100000:3.0:1789446280.172251:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773577472 00000100:00100000:3.0:1789446280.172314:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:3.0:1789446280.172325:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+6:18080:x1876369773577472:12345-192.168.206.48@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789446280.172407:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+6:18080:x1876369773577472:12345-192.168.206.48@tcp:40:mount.lustre.0 Request processed in 84us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446280.172415:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:1.0:1789446280.178654:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446280.178691:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446280.178723:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446280.178954:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773577600 00000100:00100000:2.0:1789446280.178994:0:24833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773577600 00000100:00100000:2.0:1789446280.179024:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773577728 00000100:00100000:2.0:1789446280.179027:0:24833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773577728 00000100:00100000:2.0:1789446280.179044:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:2.0:1789446280.179051:0:24833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ff44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2403:x1876369773577600:12345-192.168.206.48@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789446280.179082:0:24833:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from a97a55b2-7974-4297-b5cb-8884d980fe73@192.168.206.48@tcp t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:2.0:1789446280.179124:0:24833:0:(genops.c:1384:class_connect()) connect: client a97a55b2-7974-4297-b5cb-8884d980fe73, cookie 0x62554ff374550b4e 00002000:00100000:2.0:1789446280.179135:0:24833:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a97a55b2-7974-4297-b5cb-8884d980fe73/ffff9c2c0173f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789446280.179145:0:24833:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789446280.179362:0:24833:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789446280.179391:0:24833:0:(import.c:65:import_set_state_nolock()) ffff9c2c01738000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789446280.179448:0:24833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ff44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+6:2403:x1876369773577600:12345-192.168.206.48@tcp:8:mount.lustre.0 Request processed in 396us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446280.179468:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:2.0:1789446280.179486:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:2.0:1789446280.179491:0:24833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ff46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2403:x1876369773577728:12345-192.168.206.48@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789446280.179509:0:24833:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from a97a55b2-7974-4297-b5cb-8884d980fe73@192.168.206.48@tcp t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:2.0:1789446280.179530:0:24833:0:(genops.c:1384:class_connect()) connect: client a97a55b2-7974-4297-b5cb-8884d980fe73, cookie 0x62554ff374550b55 00002000:00100000:2.0:1789446280.179535:0:24833:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a97a55b2-7974-4297-b5cb-8884d980fe73/ffff9c2c0173b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789446280.179547:0:24833:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789446280.179674:0:24833:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789446280.179692:0:24833:0:(import.c:65:import_set_state_nolock()) ffff9c2c0821c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789446280.179716:0:24833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ff46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+6:2403:x1876369773577728:12345-192.168.206.48@tcp:8:mount.lustre.0 Request processed in 224us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446280.179729:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:3.0:1789446280.180759:0:22835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773577856 00000100:00100000:3.0:1789446280.180770:0:22835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773577856 00000100:00100000:3.0:1789446280.180825:0:22835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:3.0:1789446280.180837:0:22835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ff45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a97a55b2-7974-4297-b5cb-8884d980fe73+6:18080:x1876369773577856:12345-192.168.206.48@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789446280.180912:0:22835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ff45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a97a55b2-7974-4297-b5cb-8884d980fe73+6:18080:x1876369773577856:12345-192.168.206.48@tcp:900:mount.lustre.0 Request processed in 75us (2266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446280.180919:0:22835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:1.0:1789446280.196644:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446280.196849:0:22827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773577984 00000100:00100000:3.0:1789446280.196858:0:22827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773577984 00000100:00100000:3.0:1789446280.196913:0:22827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:3.0:1789446280.196923:0:22827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ff46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+6:18080:x1876369773577984:12345-192.168.206.48@tcp:33:mount.lustre.0 00000004:00080000:3.0:1789446280.199690:0:22827:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2651us 00000004:00200000:3.0:1789446280.212102:0:22827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789446280.212214:0:22827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ff46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+6:18080:x1876369773577984:12345-192.168.206.48@tcp:33:mount.lustre.0 Request processed in 15287us (15573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446280.212225:0:22827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00010000:00010000:1.0:1789446280.358329:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446280.422473:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789446280.422496:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3ff47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1876369794659968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789446280.422581:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446280.422763:0:24333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794659968 00000100:00100000:1.0:1789446280.422771:0:24333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794659968 00000100:00100000:1.0:1789446280.422828:0:24333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789446280.422837:0:24333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1876369794659968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789446280.422859:0:24333:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789446280.422903:0:24333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1876369794659968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446280.422910:0:24333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789446280.423171:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3ff47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1876369794659968:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789446280.423539:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789446280.462893:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446280.463339:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773578112 00000100:00100000:1.0:1789446280.463349:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773578112 00000100:00100000:1.0:1789446280.463408:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:1.0:1789446280.463417:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+6:18126:x1876369773578112:12345-192.168.206.48@tcp:101:mkdir.0 00010000:00010000:1.0:1789446280.463449:0:22824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446280.463517:0:22824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550b5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a65409 expref: -99 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446280.463579:0:22824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9de00/0x62554ff374550b63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446280.463592:0:22824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9de00/0x62554ff374550b63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446280.463604:0:22824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9de00/0x62554ff374550b63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789446280.463647:0:22824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789446280.463651:0:22824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789446280.463683:0:22824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9de00/0x62554ff374550b63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446280.463707:0:22824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550b5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65409 expref: 8 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446280.463724:0:22824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9de00/0x62554ff374550b63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65409 expref: 7 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446280.463731:0:22824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2d05f30d00) 00010000:00010000:1.0:1789446280.463733:0:22824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789446280.463736:0:22824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d2fa9de00, rc 0) 00000100:00100000:1.0:1789446280.463994:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+7:18126:x1876369773578112:12345-192.168.206.48@tcp:101:mkdir.0 Request processed in 541us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446280.464002:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:3.0:1789446280.934306:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789446280.934333:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1876369794660096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789446280.934423:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446280.934544:0:24333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794660096 00000100:00100000:1.0:1789446280.934552:0:24333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794660096 00000100:00100000:1.0:1789446280.934748:0:24333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789446280.934760:0:24333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d08193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1876369794660096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789446280.934783:0:24333:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1789446280.934836:0:24333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d08193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1876369794660096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446280.934846:0:24333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789446280.934875:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d369d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1876369794660480:0@lo:400:kworker.0 00000100:00100000:0.0:1789446280.934910:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:282408b2-7484-4ad3-93ba-27093493daa8:3659:1876369794660224:0@lo:400:kworker.0 00000100:00100000:3.0:1789446280.934911:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446280.934944:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794660992:0@lo:400:kworker.0 00000100:00100000:0.0:1789446280.934979:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789446280.935145:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789446280.935172:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1876369794660352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789446280.935268:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794660224 00000100:00100000:2.0:1789446280.935273:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794660224 00000100:00100000:2.0:1789446280.935483:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789446280.935606:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+24:3659:x1876369794660224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446280.935670:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446280.935694:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1876369794661504:0@lo:400:kworker.0 00000100:00100000:3.0:1789446280.935720:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446280.935770:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07b7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1876369794660096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789446280.935790:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789446280.935806:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d369d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1876369794660608:0@lo:400:kworker.0 00000100:00100000:0.0:1789446280.935830:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d369d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876369794660736:0@lo:400:kworker.0 00000100:00100000:3.0:1789446280.935837:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446280.935863:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794661120:0@lo:400:kworker.0 00000100:00100000:0.0:1789446280.935866:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446280.935896:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876369794661248:0@lo:400:kworker.0 00000100:00100000:3.0:1789446280.935897:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446280.935924:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1876369794661632:0@lo:400:kworker.0 00000100:00100000:0.0:1789446280.935930:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446280.935986:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794661504 00000100:00100000:3.0:1789446280.935991:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794661504 00000100:00100000:0.0:1789446280.936005:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1876369794661760:0@lo:400:kworker.0 00000100:00100000:1.0:1789446280.936031:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446280.936040:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794660736 00000100:00100000:0.0:1789446280.936041:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446280.936046:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794660736 00000100:00100000:3.0:1789446280.936065:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794661248 00000100:00100000:3.0:1789446280.936068:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794661248 00000100:00100000:1.0:1789446280.936074:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1876369794660864:0@lo:400:kworker.0 00000100:00100000:3.0:1789446280.936081:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794661760 00000100:00100000:3.0:1789446280.936084:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794661760 00000100:00100000:1.0:1789446280.936116:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446280.936138:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789446280.936147:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d08190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1876369794661504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446280.936202:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d08190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1876369794661504:12345-0@lo:400:kworker.0 Request processed in 56us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446280.936210:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789446280.936228:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789446280.936234:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876369794660736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446280.936240:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1876369794661376:0@lo:400:kworker.0 00000100:00100000:3.0:1789446280.936281:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1876369794660736:12345-0@lo:400:kworker.0 Request processed in 45us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446280.936281:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446280.936292:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789446280.936315:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794661376 00000100:00100000:3.0:1789446280.936319:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794661376 00000100:00100000:3.0:1789446280.936645:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789446280.936657:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876369794661248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446280.936692:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876369794661248:12345-0@lo:400:kworker.0 Request processed in 38us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446280.936698:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789446280.936711:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789446280.936718:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876369794661760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446280.936751:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876369794661760:12345-0@lo:400:kworker.0 Request processed in 34us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446280.936757:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789446280.936769:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789446280.936775:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ff46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876369794661376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446280.936807:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ff46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1876369794661376:12345-0@lo:400:kworker.0 Request processed in 33us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446280.936813:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789446280.936938:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1876369794661376:0@lo:400:kworker.0 00000100:00100000:3.0:1789446280.937001:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794660992 00000100:00100000:3.0:1789446280.937005:0:24833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794660992 00000100:00100000:3.0:1789446280.937030:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794660608 00000100:00100000:3.0:1789446280.937033:0:24833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794660608 00000100:00100000:3.0:1789446280.937044:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794661120 00000100:00100000:3.0:1789446280.937046:0:24833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794661120 00000100:00100000:3.0:1789446280.937061:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789446280.937067:0:24833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d08190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794660992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446280.937111:0:24833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d08190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794660992:12345-0@lo:400:kworker.0 Request processed in 44us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446280.937117:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789446280.937129:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789446280.937135:0:24833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d08190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3657:x1876369794660608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446280.937161:0:24833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d08190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3657:x1876369794660608:12345-0@lo:400:kworker.0 Request processed in 27us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446280.937167:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789446280.937258:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789446280.937265:0:24833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d08193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794661120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446280.937349:0:23565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794660480 00000100:00100000:1.0:1789446280.937353:0:22829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794660864 00000100:00100000:0.0:1789446280.937354:0:23565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794660480 00000100:00100000:1.0:1789446280.937361:0:22829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794660864 00000100:00100000:0.0:1789446280.937388:0:23565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789446280.937396:0:23565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d08192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1876369794660480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446280.937441:0:24833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d08193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794661120:12345-0@lo:400:kworker.0 Request processed in 175us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446280.937448:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789446280.937529:0:22829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789446280.937536:0:22829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ff46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1876369794660864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446280.937591:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446280.937626:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794660992:0@lo:400:kworker.0 00010000:00080000:3.0:1789446280.937643:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2c07a90000 x1876369794661504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789446280.937667:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1876369794661504:0@lo:400:kworker.0 00000100:00100000:3.0:1789446280.937688:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d369d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1876369794660608:0@lo:400:kworker.0 00000100:00100000:3.0:1789446280.937697:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794661120:0@lo:400:kworker.0 00000100:00100000:3.0:1789446280.937714:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794661632 00000100:00100000:3.0:1789446280.937718:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794661632 00000100:00100000:1.0:1789446280.937721:0:22829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ff46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1876369794660864:12345-0@lo:400:kworker.0 Request processed in 182us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446280.937746:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789446280.937753:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d08191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1876369794661632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446280.937783:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d08191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1876369794661632:12345-0@lo:400:kworker.0 Request processed in 31us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446280.937791:0:22829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789446280.937792:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789446280.937805:0:23565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d08192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1876369794660480:12345-0@lo:400:kworker.0 Request processed in 347us (2832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446280.937814:0:23565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789446280.937822:0:24334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794660352 00000100:00100000:1.0:1789446280.937827:0:24334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794660352 00000100:00100000:1.0:1789446280.937849:0:24334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789446280.937857:0:24334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ff47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876369794660352:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789446280.937858:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d369d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1876369794660736:0@lo:400:kworker.0 00000100:00100000:0.0:1789446280.937875:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876369794661248:0@lo:400:kworker.0 00002000:00000024:1.0:1789446280.937883:0:24334:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00010000:00080000:0.0:1789446280.937889:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2c07a90380 x1876369794661760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446280.937900:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1876369794661760:0@lo:400:kworker.0 00000100:00100000:1.0:1789446280.937926:0:24334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ff47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876369794660352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (1895us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446280.937934:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1876369794661632:0@lo:400:kworker.0 00000100:00100000:1.0:1789446280.937935:0:24334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789446280.937975:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d369d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1876369794660480:0@lo:400:kworker.0 00000100:00080000:1.0:1789446280.937980:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789446280.937986:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789446280.937990:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789446280.938018:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07b78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1876369794660352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789446280.938030:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1876369794660864:0@lo:400:kworker.0 00000100:00100000:2.0:1789446280.938772:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+24:3659:x1876369794660224:12345-0@lo:400:kworker.0 Request processed in 3277us (3789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446280.938783:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789446280.939006:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:282408b2-7484-4ad3-93ba-27093493daa8:3659:1876369794660224:0@lo:400:kworker.0 00000040:00080000:2.0:1789446281.256991:0:23579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789446281.382201:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789446281.961751:0:25146:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a97a55b2-7974-4297-b5cb-8884d980fe73 00000001:00080000:0.0:1789446281.961765:0:25146:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:1.0:1789446282.406387:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446282.868125:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446282.868305:0:22825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773578240 00000100:00100000:0.0:1789446282.868315:0:22825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773578240 00000100:00100000:0.0:1789446282.868391:0:22825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:0.0:1789446282.868403:0:22825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+7:18178:x1876369773578240:12345-192.168.206.48@tcp:41:lfs.0 00000004:00000024:0.0:1789446282.868467:0:22825:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789446282.868565:0:22825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+7:18178:x1876369773578240:12345-192.168.206.48@tcp:41:lfs.0 Request processed in 163us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446282.868572:0:22825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00080000:1.0:1789446282.869226:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789446282.870817:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446282.871237:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773578368 00000100:00100000:0.0:1789446282.871246:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773578368 00000100:00100000:0.0:1789446282.871326:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:0.0:1789446282.871337:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d08193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+6:18178:x1876369773578368:12345-192.168.206.48@tcp:41:lfs.0 00000004:00000024:0.0:1789446282.871370:0:22826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:1.0:1789446282.871641:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789446282.871902:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d08193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+6:18178:x1876369773578368:12345-192.168.206.48@tcp:41:lfs.0 Request processed in 566us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446282.871909:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:0.0:1789446282.882592:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446282.882749:0:24334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773578496 00000100:00100000:1.0:1789446282.882758:0:24334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773578496 00000100:00100000:1.0:1789446282.882821:0:24334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:1.0:1789446282.882830:0:24334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a97a55b2-7974-4297-b5cb-8884d980fe73+6:18178:x1876369773578496:12345-192.168.206.48@tcp:13:lfs.0 00002000:00000024:1.0:1789446282.882856:0:24334:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789446282.882941:0:24334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a97a55b2-7974-4297-b5cb-8884d980fe73+6:18178:x1876369773578496:12345-192.168.206.48@tcp:13:lfs.0 Request processed in 112us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446282.882949:0:24334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00080000:2.0:1789446282.883090:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789446282.886717:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446282.886799:0:24333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773578624 00000100:00100000:3.0:1789446282.886810:0:24333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773578624 00000100:00100000:3.0:1789446282.886878:0:24333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:3.0:1789446282.886899:0:24333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a97a55b2-7974-4297-b5cb-8884d980fe73+5:18178:x1876369773578624:12345-192.168.206.48@tcp:13:lfs.0 00002000:00000024:3.0:1789446282.886931:0:24333:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00080000:2.0:1789446282.886997:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789446282.887042:0:24333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a97a55b2-7974-4297-b5cb-8884d980fe73+5:18178:x1876369773578624:12345-192.168.206.48@tcp:13:lfs.0 Request processed in 145us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446282.887050:0:24333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:3.0:1789446283.096684:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446283.096879:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773578752 00000100:00100000:0.0:1789446283.096889:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773578752 00000100:00100000:0.0:1789446283.096945:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 131 00000100:00100000:0.0:1789446283.096994:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+10:18213:x1876369773578752:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789446283.097012:0:22816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789446283.097030:0:22816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d36a51600/0x62554ff374550b6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a65410 expref: -99 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446283.097060:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d36a51600/0x62554ff374550b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65410 expref: 11 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446283.097070:0:22816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d36a51600/0x62554ff374550b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65410 expref: 11 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446283.097107:0:22816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d36a51600, rc 0) 00000100:00100000:0.0:1789446283.097169:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+11:18213:x1876369773578752:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 214us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446283.097176:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 131 00000100:00100000:0.0:1789446283.109941:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446283.110094:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773578880 00000100:00100000:2.0:1789446283.110103:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773578880 00000100:00100000:2.0:1789446283.110151:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 132 00000100:00100000:2.0:1789446283.110160:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+11:18213:x1876369773578880:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789446283.110353:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+11:18213:x1876369773578880:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 194us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446283.110361:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 132 00000100:00100000:2.0:1789446283.114943:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446283.116857:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773579008 00000100:00100000:3.0:1789446283.116879:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773579008 00000100:00100000:3.0:1789446283.116949:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 133 00000100:00100000:3.0:1789446283.116989:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae38b160-8985-48da-9d2d-8e0f9518970b+11:18213:x1876369773579008:12345-192.168.206.48@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789446283.117152:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae38b160-8985-48da-9d2d-8e0f9518970b+11:18213:x1876369773579008:12345-192.168.206.48@tcp:503:mount.lustre.0 Request processed in 190us (2214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446283.117162:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 133 00000100:00100000:3.0:1789446283.129021:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446283.129215:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773579136 00000100:00100000:0.0:1789446283.129226:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773579136 00000100:00100000:0.0:1789446283.129285:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 134 00000100:00100000:0.0:1789446283.129296:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+11:18218:x1876369773579136:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789446283.129452:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+11:18218:x1876369773579136:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 157us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446283.129461:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 134 00000100:00100000:0.0:1789446283.157647:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446283.157845:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773579264 00000100:00100000:2.0:1789446283.157859:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773579264 00000100:00100000:2.0:1789446283.158004:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 135 00000100:00100000:2.0:1789446283.158017:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+11:18218:x1876369773579264:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789446283.162915:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+11:18218:x1876369773579264:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 4890us (5273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446283.162946:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 135 00000100:00100000:2.0:1789446283.176059:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446283.176131:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773579392 00000100:00100000:3.0:1789446283.176141:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773579392 00000100:00100000:3.0:1789446283.176191:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 136 00000100:00100000:3.0:1789446283.176201:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae38b160-8985-48da-9d2d-8e0f9518970b+11:18218:x1876369773579392:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789446283.176431:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae38b160-8985-48da-9d2d-8e0f9518970b+11:18218:x1876369773579392:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 230us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446283.176449:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 136 00000100:00100000:3.0:1789446283.184189:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446283.184780:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773579520 00000100:00100000:2.0:1789446283.184803:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773579520 00000100:00100000:2.0:1789446283.184924:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 137 00000100:00100000:2.0:1789446283.184937:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+11:18213:x1876369773579520:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789446283.184954:0:22819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789446283.185011:0:22819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d13ba7c00/0x62554ff374550b71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a65441 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446283.185043:0:22819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d13ba7c00/0x62554ff374550b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65441 expref: 12 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446283.185056:0:22819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d13ba7c00/0x62554ff374550b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65441 expref: 12 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446283.185066:0:22819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d13ba7c00, rc 0) 00000100:00100000:2.0:1789446283.185146:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+12:18213:x1876369773579520:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 212us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446283.185153:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 137 00000100:00100000:0.0:1789446283.191206:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446283.191685:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773579648 00000100:00100000:3.0:1789446283.191696:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773579648 00000100:00100000:3.0:1789446283.192017:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 138 00000100:00100000:3.0:1789446283.192027:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c018a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae38b160-8985-48da-9d2d-8e0f9518970b+12:18213:x1876369773579648:12345-192.168.206.48@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789446283.192050:0:22818:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789446283.192073:0:22818:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789446283.192088:0:22818:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789446283.192091:0:22818:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789446283.192094:0:22818:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789446283.192097:0:22818:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1789446283.198761:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c018a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae38b160-8985-48da-9d2d-8e0f9518970b+12:18213:x1876369773579648:12345-192.168.206.48@tcp:256:mount.lustre.0 Request processed in 6724us (7553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446283.198774:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 138 00000100:00100000:1.0:1789446283.205935:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446283.206111:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773579776 00000100:00100000:2.0:1789446283.206126:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773579776 00000100:00100000:2.0:1789446283.206200:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 139 00000100:00100000:2.0:1789446283.206211:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+12:18213:x1876369773579776:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789446283.206244:0:22819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789446283.206273:0:22819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d13ba6200/0x62554ff374550b78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a65448 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446283.206303:0:22819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d13ba6200/0x62554ff374550b78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65448 expref: 13 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446283.206316:0:22819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d13ba6200/0x62554ff374550b78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65448 expref: 13 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446283.206325:0:22819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d13ba6200, rc 0) 00000100:00100000:2.0:1789446283.206392:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+13:18213:x1876369773579776:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 183us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446283.206399:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 139 00000100:00100000:0.0:1789446283.210217:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446283.210785:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773579904 00000100:00100000:2.0:1789446283.210795:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773579904 00000100:00100000:2.0:1789446283.210856:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 140 00000100:00100000:2.0:1789446283.210866:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae38b160-8985-48da-9d2d-8e0f9518970b+13:18213:x1876369773579904:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789446283.211107:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae38b160-8985-48da-9d2d-8e0f9518970b+13:18213:x1876369773579904:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 242us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446283.211116:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 140 00000100:00100000:3.0:1789446283.215037:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446283.215949:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773580032 00000100:00100000:0.0:1789446283.216012:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773580032 00000100:00100000:0.0:1789446283.216096:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 141 00000100:00100000:0.0:1789446283.216108:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+13:18213:x1876369773580032:12345-192.168.206.48@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789446283.216260:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+13:18213:x1876369773580032:12345-192.168.206.48@tcp:503:mount.lustre.0 Request processed in 153us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446283.216282:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 141 00000100:00100000:1.0:1789446283.225416:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446283.225813:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773580160 00000100:00100000:3.0:1789446283.225828:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773580160 00000100:00100000:3.0:1789446283.225910:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 142 00000100:00100000:3.0:1789446283.225922:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae38b160-8985-48da-9d2d-8e0f9518970b+13:18223:x1876369773580160:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789446283.232800:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae38b160-8985-48da-9d2d-8e0f9518970b+13:18223:x1876369773580160:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 6868us (7385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446283.232814:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 142 00000100:00100000:1.0:1789446283.253769:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446283.257744:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773580288 00000100:00100000:3.0:1789446283.257759:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773580288 00000100:00100000:2.0:1789446283.261713:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 143 00000100:00100000:2.0:1789446283.261729:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+13:18223:x1876369773580288:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789446283.261895:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+13:18223:x1876369773580288:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 169us (8134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446283.266529:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 143 00000100:00100000:3.0:1789446283.274583:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446283.274637:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446283.274808:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773580416 00000100:00100000:2.0:1789446283.274822:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773580416 00000100:00100000:2.0:1789446283.274872:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773580672 00000100:00100000:2.0:1789446283.274876:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773580672 00000100:00100000:2.0:1789446283.274914:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:2.0:1789446283.274922:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d369d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1876369773580416:12345-192.168.206.48@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789446283.274951:0:25435:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 79ee354c-8e5b-496d-a1d3-11b6cf01e70d@192.168.206.48@tcp t0 exp 0000000000000000 cur 665 last 0 00000020:00000080:2.0:1789446283.275037:0:25435:0:(genops.c:1384:class_connect()) connect: client 79ee354c-8e5b-496d-a1d3-11b6cf01e70d, cookie 0x62554ff374550b7f 00000004:00100000:2.0:1789446283.275086:0:25435:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789446283.275191:0:25435:0:(import.c:65:import_set_state_nolock()) ffff9c2d39f4c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789446283.275249:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:3.0:1789446283.275262:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d369d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1876369773580672:12345-192.168.206.48@tcp:38:mount.lustre.0 00000100:00100000:2.0:1789446283.275286:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d369d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:2403:x1876369773580416:12345-192.168.206.48@tcp:38:mount.lustre.0 Request processed in 360us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446283.275296:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 16 00010000:00080000:3.0:1789446283.275312:0:22824:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 79ee354c-8e5b-496d-a1d3-11b6cf01e70d@192.168.206.48@tcp t0 exp 0000000000000000 cur 665 last 0 00000020:00000080:3.0:1789446283.275357:0:22824:0:(genops.c:1384:class_connect()) connect: client 79ee354c-8e5b-496d-a1d3-11b6cf01e70d, cookie 0x62554ff374550b86 00000004:00100000:3.0:1789446283.275382:0:22824:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789446283.275483:0:22824:0:(import.c:65:import_set_state_nolock()) ffff9c2d3df2c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789446283.275546:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d369d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:2403:x1876369773580672:12345-192.168.206.48@tcp:38:mount.lustre.0 Request processed in 285us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446283.275555:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:1.0:1789446283.290790:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446283.290848:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446283.291237:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773580544 00000100:00100000:3.0:1789446283.291250:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773580544 00000100:00100000:3.0:1789446283.291467:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773580800 00000100:00100000:3.0:1789446283.291472:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773580800 00000100:00100000:2.0:1789446283.292026:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:2.0:1789446283.292051:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ff44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:0:x1876369773580544:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789446283.292118:0:25435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789446283.292229:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ff44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:0:x1876369773580544:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 185us (1454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446283.292239:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00080000:1.0:1789446283.302917:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789446283.302933:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789446283.306579:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:3.0:1789446283.306603:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ff45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:0:x1876369773580800:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789446283.306657:0:22824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789446283.310626:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ff45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:0:x1876369773580800:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 4012us (19755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446283.310645:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:0.0:1789446283.314729:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446283.315495:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773580928 00000100:00100000:2.0:1789446283.315510:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773580928 00000100:00100000:2.0:1789446283.315593:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:2.0:1789446283.315606:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:18213:x1876369773580928:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789446283.315649:0:25435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789446283.315732:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:18213:x1876369773580928:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 128us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446283.315764:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:0.0:1789446283.324390:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446283.324598:0:22825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773581056 00000100:00100000:1.0:1789446283.324611:0:22825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773581056 00000100:00100000:1.0:1789446283.324690:0:22825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:1.0:1789446283.324703:0:22825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:18213:x1876369773581056:12345-192.168.206.48@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789446283.324847:0:22825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:18213:x1876369773581056:12345-192.168.206.48@tcp:40:mount.lustre.0 Request processed in 146us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446283.324855:0:22825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:0.0:1789446283.329272:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446283.329441:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446283.329489:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446283.329542:0:22835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773581440 00000100:00100000:2.0:1789446283.329555:0:22835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773581440 00000100:00100000:2.0:1789446283.329628:0:22835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:2.0:1789446283.329641:0:22835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:18213:x1876369773581440:12345-192.168.206.48@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789446283.329744:0:22835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:18213:x1876369773581440:12345-192.168.206.48@tcp:900:mount.lustre.0 Request processed in 106us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446283.329752:0:22835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:2.0:1789446283.333582:0:24330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773581184 00000100:00100000:2.0:1789446283.333604:0:24330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773581184 00000100:00100000:2.0:1789446283.333662:0:24330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773581312 00000100:00100000:2.0:1789446283.333667:0:24330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773581312 00000100:00100000:2.0:1789446283.333705:0:24330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:2.0:1789446283.333715:0:24330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2403:x1876369773581184:12345-192.168.206.48@tcp:8:mount.lustre.0 00000100:00100000:0.0:1789446283.333728:0:24332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:0.0:1789446283.333735:0:24332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2403:x1876369773581312:12345-192.168.206.48@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789446283.333783:0:24332:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 79ee354c-8e5b-496d-a1d3-11b6cf01e70d@192.168.206.48@tcp t0 exp 0000000000000000 cur 665 last 0 00010000:00080000:2.0:1789446283.333801:0:24330:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 79ee354c-8e5b-496d-a1d3-11b6cf01e70d@192.168.206.48@tcp t0 exp 0000000000000000 cur 665 last 0 00000020:00000080:2.0:1789446283.333845:0:24330:0:(genops.c:1384:class_connect()) connect: client 79ee354c-8e5b-496d-a1d3-11b6cf01e70d, cookie 0x62554ff374550b8d 00002000:00100000:2.0:1789446283.333860:0:24330:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 79ee354c-8e5b-496d-a1d3-11b6cf01e70d/ffff9c2c08218000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789446283.333875:0:24330:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000080:0.0:1789446283.335655:0:24332:0:(genops.c:1384:class_connect()) connect: client 79ee354c-8e5b-496d-a1d3-11b6cf01e70d, cookie 0x62554ff374550b94 00002000:00100000:0.0:1789446283.335671:0:24332:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 79ee354c-8e5b-496d-a1d3-11b6cf01e70d/ffff9c2c0890c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789446283.335684:0:24332:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789446283.335918:0:24332:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789446283.335995:0:24332:0:(import.c:65:import_set_state_nolock()) ffff9c2c0890e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789446283.336102:0:24332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:2403:x1876369773581312:12345-192.168.206.48@tcp:8:mount.lustre.0 Request processed in 2363us (6610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446283.336114:0:24332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:0.0:1789446283.337026:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446283.339172:0:22828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773581568 00000100:00100000:1.0:1789446283.339197:0:22828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773581568 00000100:00100000:1.0:1789446283.339276:0:22828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:1.0:1789446283.339306:0:22828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:18213:x1876369773581568:12345-192.168.206.48@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789446283.339613:0:22828:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789446283.339722:0:22828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:18213:x1876369773581568:12345-192.168.206.48@tcp:33:mount.lustre.0 Request processed in 435us (2703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446283.339730:0:22828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 1 00002000:00080000:2.0:1789446283.340321:0:24330:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789446283.340369:0:24330:0:(import.c:65:import_set_state_nolock()) ffff9c2c08219800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789446283.340443:0:24330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:2403:x1876369773581184:12345-192.168.206.48@tcp:8:mount.lustre.0 Request processed in 6725us (11183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446283.340455:0:24330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 20 00010000:00010000:3.0:1789446283.432366:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446283.566625:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446283.566754:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773581696 00000100:00100000:2.0:1789446283.566764:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773581696 00000100:00100000:2.0:1789446283.566838:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:2.0:1789446283.566848:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:18246:x1876369773581696:12345-192.168.206.48@tcp:101:mkdir.0 00010000:00010000:2.0:1789446283.566869:0:25435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789446283.566891:0:25435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6e00/0x62554ff374550b9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a65479 expref: -99 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446283.566952:0:25435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7000/0x62554ff374550ba2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446283.566991:0:25435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7000/0x62554ff374550ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446283.567004:0:25435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7000/0x62554ff374550ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789446283.567050:0:25435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789446283.567054:0:25435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789446283.567083:0:25435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7000/0x62554ff374550ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446283.567119:0:25435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6e00/0x62554ff374550b9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65479 expref: 8 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446283.567138:0:25435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7000/0x62554ff374550ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65479 expref: 7 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446283.567146:0:25435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2d05f30d00) 00010000:00010000:2.0:1789446283.567149:0:25435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789446283.567154:0:25435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d13ba7000, rc 0) 00000100:00100000:2.0:1789446283.567221:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+7:18246:x1876369773581696:12345-192.168.206.48@tcp:101:mkdir.0 Request processed in 375us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446283.567235:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 22 00010000:00010000:1.0:1789446284.455865:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789446284.518689:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3ff47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794662016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789446284.518800:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446284.518887:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789446284.518898:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2a235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794661888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789446284.518925:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446284.519859:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794662144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789446284.519896:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446284.519985:0:24334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794662144 00000100:00100000:2.0:1789446284.519994:0:24334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794662144 00000100:00080000:0.0:1789446284.520080:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789446284.520104:0:24334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789446284.520116:0:24334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a234700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794662144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789446284.520142:0:24334:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789446284.520342:0:24334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a234700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794662144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 228us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446284.520350:0:24334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789446284.520447:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794662144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789446284.524727:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794662016 00000100:00100000:3.0:1789446284.524742:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794662016 00000100:00100000:3.0:1789446284.524820:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794661888 00000100:00100000:3.0:1789446284.524824:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794661888 00000100:00100000:3.0:1789446284.524845:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789446284.524853:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ff47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794662016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789446284.524889:0:22830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789446284.524987:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ff47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794662016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (6186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446284.524994:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789446284.525046:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3ff47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794662016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789446284.525098:0:23565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789446284.525109:0:23565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794661888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789446284.525129:0:23565:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789446284.525198:0:23565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794661888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (6272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446284.526280:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2a235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794661888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789446284.532740:0:23565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:3.0:1789446285.479564:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789446285.542336:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794662272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789446285.542402:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446285.542476:0:24334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794662272 00000100:00100000:2.0:1789446285.542485:0:24334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794662272 00000100:00080000:1.0:1789446285.542527:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789446285.542533:0:24334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789446285.542543:0:24334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794662272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789446285.542564:0:24334:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789446285.542623:0:24334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794662272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446285.542630:0:24334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789446285.542761:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794662272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789446286.054761:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1876369794662400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789446286.054864:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446286.056616:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789446286.056632:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1876369794662528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789446286.056684:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446286.056720:0:24333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794662400 00000100:00100000:2.0:1789446286.056728:0:24333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794662400 00000100:00100000:2.0:1789446286.056769:0:24333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794662528 00000100:00100000:2.0:1789446286.056772:0:24333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794662528 00000100:00100000:2.0:1789446286.056791:0:24333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789446286.056799:0:24333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d369d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876369794662400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789446286.056844:0:24333:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789446286.056890:0:24333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d369d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876369794662400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (2026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446286.056898:0:24333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789446286.056914:0:24333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789446286.056920:0:24333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1876369794662528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789446286.056930:0:24333:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789446286.056990:0:24333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1876369794662528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446286.056997:0:24333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789446286.057029:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1789446286.057049:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07b7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1876369794662528:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789446286.057250:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789446286.058134:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794662784:0@lo:400:kworker.0 00000100:00100000:1.0:1789446286.058176:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446286.058208:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794663296:0@lo:400:kworker.0 00000100:00100000:1.0:1789446286.058229:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446286.058245:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1876369794663808:0@lo:400:kworker.0 00000100:00100000:1.0:1789446286.058272:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446286.058291:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789446286.058297:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794662912:0@lo:400:kworker.0 00000100:00100000:1.0:1789446286.058317:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446286.058331:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876369794663424:0@lo:400:kworker.0 00000100:00100000:1.0:1789446286.058350:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446286.058364:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1876369794663936:0@lo:400:kworker.0 00000100:00100000:1.0:1789446286.058382:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446286.058535:0:22829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794662784 00000100:00100000:1.0:1789446286.058541:0:22829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794662784 00000100:00100000:1.0:1789446286.058576:0:22829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789446286.058584:0:22829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794662784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446286.058631:0:22829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794662784:12345-0@lo:400:kworker.0 Request processed in 48us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446286.058637:0:22829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789446286.058685:0:24331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794663296 00000100:00100000:1.0:1789446286.058689:0:24331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794663296 00000100:00100000:1.0:1789446286.058719:0:24331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794662912 00000100:00100000:1.0:1789446286.058722:0:24331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794662912 00000100:00100000:1.0:1789446286.058738:0:24331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789446286.058743:0:24331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794663296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446286.058771:0:24331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794663296:12345-0@lo:400:kworker.0 Request processed in 28us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446286.058777:0:24331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789446286.058787:0:24331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789446286.058792:0:24331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794662912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446286.058814:0:24331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794662912:12345-0@lo:400:kworker.0 Request processed in 22us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446286.058818:0:24331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789446286.058845:0:22825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794663808 00000100:00100000:1.0:1789446286.058848:0:22825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794663808 00000100:00100000:1.0:1789446286.058872:0:22825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794663424 00000100:00100000:1.0:1789446286.058874:0:22825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794663424 00000100:00100000:1.0:1789446286.058884:0:22825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794663936 00000100:00100000:1.0:1789446286.058886:0:22825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794663936 00000100:00100000:1.0:1789446286.058897:0:22825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789446286.058903:0:22825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876369794663808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446286.058931:0:22825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876369794663808:12345-0@lo:400:kworker.0 Request processed in 28us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446286.058937:0:22825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789446286.058947:0:22825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789446286.058952:0:22825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876369794663424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446286.059377:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789446286.059387:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876369794663936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446286.059435:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876369794663936:12345-0@lo:400:kworker.0 Request processed in 51us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446286.059441:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789446286.059466:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:282408b2-7484-4ad3-93ba-27093493daa8:3658:1876369794662656:0@lo:400:kworker.0 00000100:00100000:2.0:1789446286.059496:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446286.059528:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794663168:0@lo:400:kworker.0 00000100:00100000:2.0:1789446286.059549:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446286.059567:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1876369794663680:0@lo:400:kworker.0 00000100:00100000:2.0:1789446286.059585:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446286.059602:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789446286.059617:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1876369794663040:0@lo:400:kworker.0 00000100:00100000:2.0:1789446286.059641:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446286.059651:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1876369794663552:0@lo:400:kworker.0 00000100:00100000:2.0:1789446286.059680:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446286.059700:0:23565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794663168 00000100:00100000:2.0:1789446286.059704:0:23565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794663168 00000100:00100000:2.0:1789446286.059731:0:23565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789446286.059737:0:23565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794663168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446286.059771:0:23565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794663168:12345-0@lo:400:kworker.0 Request processed in 34us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446286.059776:0:23565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789446286.059790:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794663680 00000100:00100000:2.0:1789446286.059793:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794663680 00000100:00100000:2.0:1789446286.059807:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794663040 00000100:00100000:2.0:1789446286.059810:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794663040 00000100:00100000:2.0:1789446286.059819:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794663552 00000100:00100000:2.0:1789446286.059821:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794663552 00000100:00100000:2.0:1789446286.059833:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789446286.059837:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1876369794663680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446286.059863:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1876369794663680:12345-0@lo:400:kworker.0 Request processed in 26us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446286.059868:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789446286.059878:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789446286.059883:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1876369794663040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446286.059906:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1876369794663040:12345-0@lo:400:kworker.0 Request processed in 23us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446286.059911:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789446286.059944:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789446286.059949:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1876369794663552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446286.060008:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1876369794663552:12345-0@lo:400:kworker.0 Request processed in 59us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446286.060014:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789446286.060216:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1876369794663040:0@lo:400:kworker.0 00000100:00100000:2.0:1789446286.060226:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1876369794663552:0@lo:400:kworker.0 00000100:00100000:2.0:1789446286.060234:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794663168:0@lo:400:kworker.0 00010000:00080000:2.0:1789446286.060243:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2d3edcf800 x1876369794663680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446286.060253:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1876369794663680:0@lo:400:kworker.0 00000100:00080000:2.0:1789446286.060364:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789446286.060369:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789446286.060372:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789446286.060414:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794662912:0@lo:400:kworker.0 00010000:00080000:2.0:1789446286.060428:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2d3edcfb80 x1876369794663936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446286.060438:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1876369794663936:0@lo:400:kworker.0 00000100:00100000:2.0:1789446286.060449:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c082d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794662784:0@lo:400:kworker.0 00000100:00100000:2.0:1789446286.060457:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794663296:0@lo:400:kworker.0 00000100:00100000:2.0:1789446286.060467:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1876369794663808:0@lo:400:kworker.0 00000100:00100000:2.0:1789446286.060553:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794662656 00000100:00100000:2.0:1789446286.060565:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794662656 00000100:00100000:2.0:1789446286.060616:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789446286.060623:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+24:3658:x1876369794662656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446286.060662:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+24:3658:x1876369794662656:12345-0@lo:400:kworker.0 Request processed in 40us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446286.060669:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789446286.060736:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:282408b2-7484-4ad3-93ba-27093493daa8:3658:1876369794662656:0@lo:400:kworker.0 00000100:00100000:1.0:1789446286.061007:0:22825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876369794663424:12345-0@lo:400:kworker.0 Request processed in 2052us (2654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446286.061021:0:22825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789446286.061603:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07b78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1876369794662400:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1789446286.062250:0:22804:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 79ee354c-8e5b-496d-a1d3-11b6cf01e70d 00000001:00100000:0.0:1789446286.062258:0:22804:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a97a55b2-7974-4297-b5cb-8884d980fe73 00000001:00100000:0.0:1789446286.063152:0:23557:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 79ee354c-8e5b-496d-a1d3-11b6cf01e70d 00000001:00100000:0.0:1789446286.063161:0:23557:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a97a55b2-7974-4297-b5cb-8884d980fe73 00000100:00100000:2.0:1789446286.063928:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876369794663424:0@lo:400:kworker.0 00000001:00100000:1.0:1789446286.067879:0:24326:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 79ee354c-8e5b-496d-a1d3-11b6cf01e70d 00000001:00100000:1.0:1789446286.067894:0:24326:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a97a55b2-7974-4297-b5cb-8884d980fe73 00010000:00010000:1.0:1789446286.503432:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789446286.829543:0:22862:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1789446286.923912:0:25704:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789446287.527073:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789446288.479061:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446288.479119:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446288.479170:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446288.479197:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446288.479221:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446288.479243:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446288.479290:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446288.479318:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446288.479349:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446288.479389:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773582080 00000100:00100000:3.0:1789446288.479402:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773582080 00000100:00100000:3.0:1789446288.479471:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773582592 00000100:00100000:3.0:1789446288.479489:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773582592 00000100:00100000:3.0:1789446288.479515:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773581952 00000100:00100000:3.0:1789446288.479518:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773581952 00000100:00100000:3.0:1789446288.479535:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773582464 00000100:00100000:3.0:1789446288.479537:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773582464 00000100:00100000:3.0:1789446288.479556:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:3.0:1789446288.479569:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ff47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+5:2404:x1876369773582080:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789446288.479679:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ff47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+5:2404:x1876369773582080:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 112us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446288.479689:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:3.0:1789446288.479724:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:3.0:1789446288.479733:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+5:2404:x1876369773582592:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789446288.479759:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+5:2404:x1876369773582592:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 28us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446288.479765:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:3.0:1789446288.479776:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:3.0:1789446288.479782:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+6:2404:x1876369773581952:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789446288.480139:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+6:2404:x1876369773581952:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 353us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446288.480151:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:3.0:1789446288.480176:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:3.0:1789446288.480187:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:2404:x1876369773582464:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789446288.480221:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:2404:x1876369773582464:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 38us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446288.480229:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:3.0:1789446288.480386:0:24331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773582336 00000100:00100000:3.0:1789446288.480392:0:24331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773582336 00000100:00100000:3.0:1789446288.480420:0:24331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773582848 00000100:00100000:3.0:1789446288.480424:0:24331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773582848 00000100:00100000:3.0:1789446288.480437:0:24331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773582208 00000100:00100000:3.0:1789446288.480439:0:24331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773582208 00000100:00100000:3.0:1789446288.480452:0:24331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773582720 00000100:00100000:3.0:1789446288.480455:0:24331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773582720 00000100:00100000:3.0:1789446288.480471:0:24331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:3.0:1789446288.480477:0:24331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+5:2404:x1876369773582336:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789446288.480512:0:24331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+5:2404:x1876369773582336:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 34us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446288.480520:0:24331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:3.0:1789446288.480545:0:24331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:3.0:1789446288.480555:0:24331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:2404:x1876369773582848:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789446288.480585:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773581824 00000100:00100000:3.0:1789446288.480586:0:24331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:2404:x1876369773582848:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 33us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446288.480600:0:24331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:1.0:1789446288.480602:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773581824 00000100:00100000:1.0:1789446288.480672:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 145 00000100:00100000:1.0:1789446288.480681:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+13:2404:x1876369773581824:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789446288.480749:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+13:2404:x1876369773581824:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 69us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446288.480757:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 145 00000100:00100000:1.0:1789446288.482172:0:24332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:1.0:1789446288.482190:0:24332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+5:2404:x1876369773582208:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789446288.482247:0:24331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:1.0:1789446288.482261:0:24332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+5:2404:x1876369773582208:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 76us (2967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446288.482271:0:24332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:3.0:1789446288.482415:0:24331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+5:2404:x1876369773582720:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789446288.482475:0:24331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+5:2404:x1876369773582720:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 216us (3124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446288.482483:0:24331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00080000:3.0:1789446288.482530:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789446288.482536:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789446288.482541:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789446288.482543:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789446288.552235:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789446289.135371:0:25146:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 79ee354c-8e5b-496d-a1d3-11b6cf01e70d 00010000:00010000:3.0:1789446289.581408:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446289.640246:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789446289.640277:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794664064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789446289.640352:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446289.640491:0:23565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794664064 00000100:00100000:0.0:1789446289.640502:0:23565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794664064 00000100:00100000:0.0:1789446289.640707:0:23565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789446289.640721:0:23565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794664064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789446289.640772:0:23565:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789446289.640780:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c07a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794664320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789446289.640828:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446289.640889:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789446289.641033:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794664192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789446289.641087:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446289.641126:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794664320 00000100:00100000:3.0:1789446289.641133:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794664320 00000100:00100000:3.0:1789446289.641173:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789446289.641181:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794664320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789446289.641247:0:22830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789446289.641311:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794664320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446289.641318:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789446289.641380:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c07a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794664320:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789446289.643202:0:23565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794664064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2474us (2839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446289.643217:0:23565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789446289.643662:0:24333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794664192 00000100:00100000:2.0:1789446289.643676:0:24333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794664192 00000100:00100000:2.0:1789446289.643765:0:24333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789446289.643778:0:24333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c081d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794664192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789446289.643812:0:24333:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789446289.643891:0:24333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c081d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794664192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (2803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446289.643898:0:24333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789446289.643947:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794664192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789446289.644020:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794664064:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1789446289.646239:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789446290.599228:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446290.675080:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789446290.675100:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794664448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789446290.675175:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446290.675233:0:24333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794664448 00000100:00100000:2.0:1789446290.675240:0:24333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794664448 00000100:00100000:2.0:1789446290.675304:0:24333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789446290.675313:0:24333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c082d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794664448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789446290.675334:0:24333:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789446290.675376:0:24333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c082d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794664448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446290.675383:0:24333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789446290.675681:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789446290.675782:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794664448:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1789446290.900998:0:25852:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff58ccf0e0 20000000:00000080:0.0:1789446290.901016:0:25852:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c2d3f745800 uarg=0000000000000000 20000000:01000000:0.0:1789446290.901074:0:25852:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789446290.901079:0:25852:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789446290.901084:0:25852:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789446290.903724:0:25853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1789446290.904154:0:25852:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789446290.916934:0:25852:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789446290.916997:0:25852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550ba9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446290.917016:0:25852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2d36806c00/0x62554ff374550806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff3745507ff expref: 23 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446290.917054:0:25852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2d36a50c00/0x62554ff374550814 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff37455080d expref: 23 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446290.917061:0:25852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2d35ea7000/0x62554ff374550853 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff37455084c expref: 23 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446290.917068:0:25852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2d13ba6600/0x62554ff3745509d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff3745509cd expref: 23 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446290.917077:0:25852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2d13ba7600/0x62554ff374550b39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a653d8 expref: 12 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446290.917083:0:25852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2d13ba6200/0x62554ff374550b78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65448 expref: 12 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446290.917090:0:25852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550ba9 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446290.917128:0:25852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2d13ba6200/0x62554ff374550b78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65448 expref: 12 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446290.917142:0:25852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2d13ba6200/0x62554ff374550b78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65448 expref: 12 pid: 22819 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446290.917155:0:25852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2a235500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1876369794664576:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789446290.917257:0:25852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2d13ba7600/0x62554ff374550b39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a653d8 expref: 12 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446290.917265:0:25852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2d13ba7600/0x62554ff374550b39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a653d8 expref: 12 pid: 22818 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446290.917280:0:25852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2a237480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1876369794664704:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789446290.917311:0:25852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2d13ba6600/0x62554ff3745509d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x62554ff3745509cd expref: 23 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446290.917319:0:25852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2d13ba6600/0x62554ff3745509d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x62554ff3745509cd expref: 23 pid: 22816 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446290.917327:0:25852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2a236300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1876369794664832:0@lo:104: 00000100:00100000:0.0:1789446290.917358:0:25852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789446290.917406:0:25852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2d35ea7000/0x62554ff374550853 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x62554ff37455084c expref: 23 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446290.917413:0:25852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2d35ea7000/0x62554ff374550853 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x62554ff37455084c expref: 23 pid: 22818 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446290.917421:0:25852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2a235180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1876369794664960:0@lo:104: 00000100:00100000:0.0:1789446290.917440:0:25852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789446290.917478:0:25852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2d36a50c00/0x62554ff374550814 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x62554ff37455080d expref: 23 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446290.917486:0:25852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2d36a50c00/0x62554ff374550814 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x62554ff37455080d expref: 23 pid: 22819 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446290.917494:0:25852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08062a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1876369794665088:0@lo:104: 00000100:00100000:3.0:1789446290.917507:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794664832 00000100:00100000:3.0:1789446290.917514:0:22807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794664832 00000100:00100000:0.0:1789446290.917536:0:25852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446290.917549:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794664960 00000100:00100000:3.0:1789446290.917552:0:22807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794664960 00010000:00010000:0.0:1789446290.917560:0:25852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2d36806c00/0x62554ff374550806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x62554ff3745507ff expref: 23 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446290.917562:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794665088 00000100:00100000:3.0:1789446290.917564:0:22807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794665088 00000100:00100000:3.0:1789446290.917575:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1789446290.917578:0:25852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2d36806c00/0x62554ff374550806 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x62554ff3745507ff expref: 23 pid: 22816 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446290.917586:0:25852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08f95180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1876369794665216:0@lo:104: 00000100:00100000:3.0:1789446290.917595:0:22807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a234e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:282408b2-7484-4ad3-93ba-27093493daa8+5:25852:x1876369794664832:12345-0@lo:104: 00000100:00100000:0.0:1789446290.917607:0:25852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789446290.917608:0:22807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50800/0x62554ff3745509cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff3745509d4 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446290.917622:0:25852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d086d50c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789446290.917675:0:22807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789446290.917681:0:22807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a234e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:282408b2-7484-4ad3-93ba-27093493daa8+5:25852:x1876369794664832:12345-0@lo:104: Request processed in 87us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446290.917692:0:22808:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1789446290.917696:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789446290.917699:0:22808:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1789446290.917711:0:22807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794665216 00000100:00100000:3.0:1789446290.917715:0:22807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794665216 00000100:00100000:3.0:1789446290.917730:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789446290.917735:0:22807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a235880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:282408b2-7484-4ad3-93ba-27093493daa8+5:25852:x1876369794664960:12345-0@lo:104: 00010000:00010000:3.0:1789446290.917741:0:22807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9c2d36807600/0x62554ff37455084c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff374550853 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446290.917773:0:22807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789446290.917778:0:22807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a235880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:282408b2-7484-4ad3-93ba-27093493daa8+5:25852:x1876369794664960:12345-0@lo:104: Request processed in 43us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446290.917784:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789446290.917796:0:22808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789446290.917813:0:22808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08f96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:282408b2-7484-4ad3-93ba-27093493daa8+4:25852:x1876369794665088:12345-0@lo:104: 00010000:00010000:2.0:1789446290.917822:0:22808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37455080d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff374550814 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446290.917852:0:22808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789446290.917857:0:22808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08f96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:282408b2-7484-4ad3-93ba-27093493daa8+4:25852:x1876369794665088:12345-0@lo:104: Request processed in 46us (321us total) trans 0 rc 0/0 00010000:00010000:1.0:1789446290.918188:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789446290.918196:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50800/0x62554ff3745509cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff3745509d4 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.918205:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36a50800 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:1.0:1789446290.918209:0:22813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50800/0x62554ff3745509cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x62554ff3745509d4 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.918218:0:22813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50800/0x62554ff3745509cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x62554ff3745509d4 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789446290.918231:0:22813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50800/0x62554ff3745509cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x62554ff3745509d4 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789446290.918238:0:22813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789446290.918266:0:22813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50800/0x62554ff3745509cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745509d4 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.918272:0:22813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789446290.918290:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50800/0x62554ff3745509cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745509d4 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.918298:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d36a50800/0x62554ff3745509cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff3745509d4 expref: -99 pid: 25145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.918311:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789446290.918314:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d36807600/0x62554ff37455084c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff374550853 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.918320:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36807600 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:1.0:1789446290.918324:0:22813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d36807600/0x62554ff37455084c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x62554ff374550853 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.918331:0:22813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d36807600/0x62554ff37455084c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x62554ff374550853 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789446290.918338:0:22813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d36807600/0x62554ff37455084c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x62554ff374550853 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789446290.918344:0:22813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789446290.918362:0:22813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9c2d36807600/0x62554ff37455084c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff374550853 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.918369:0:22813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789446290.918375:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d36807600/0x62554ff37455084c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff374550853 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.918381:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d36807600/0x62554ff37455084c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff374550853 expref: -99 pid: 24325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.918390:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789446290.918393:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37455080d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff374550814 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.918399:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36806400 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:1.0:1789446290.918402:0:22813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37455080d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x62554ff374550814 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.918409:0:22813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37455080d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x62554ff374550814 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789446290.918416:0:22813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37455080d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x62554ff374550814 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789446290.918421:0:22813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789446290.918432:0:22813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37455080d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff374550814 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.918438:0:22813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789446290.918452:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37455080d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff374550814 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.918469:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d36806400/0x62554ff37455080d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff374550814 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.918479:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446290.918481:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446290.918482:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446290.918488:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789446290.918507:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:282408b2-7484-4ad3-93ba-27093493daa8:3657:1876369794665344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789446290.918537:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446290.918556:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789446290.918562:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:282408b2-7484-4ad3-93ba-27093493daa8:3657:1876369794665472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789446290.918579:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446290.918615:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:282408b2-7484-4ad3-93ba-27093493daa8:3659:1876369794665600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789446290.918637:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446290.918668:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794665344 00000100:00100000:1.0:1789446290.918673:0:22809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794665344 00010000:00010000:1.0:1789446290.918693:0:22809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2d13ba6600/0x62554ff3745509d4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff3745509cd expref: 24 pid: 22816 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446290.918711:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794665472 00000100:00100000:1.0:1789446290.918714:0:22809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794665472 00010000:00010000:1.0:1789446290.918724:0:22809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2d35ea7000/0x62554ff374550853 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff37455084c expref: 25 pid: 22818 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446290.918748:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794665600 00000100:00100000:1.0:1789446290.918750:0:22809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794665600 00010000:00010000:1.0:1789446290.918761:0:22809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2d36a50c00/0x62554ff374550814 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff37455080d expref: 26 pid: 22819 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446290.918786:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789446290.918792:0:22809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:282408b2-7484-4ad3-93ba-27093493daa8+26:3657:x1876369794665344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789446290.918802:0:22809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789446290.918807:0:22809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2d13ba6600/0x62554ff3745509d4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff3745509cd expref: 26 pid: 22816 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.918814:0:22809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2d13ba6600/0x62554ff3745509d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x62554ff3745509cd expref: 26 pid: 22816 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.918829:0:22809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789446290.918856:0:22809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:282408b2-7484-4ad3-93ba-27093493daa8+26:3657:x1876369794665344:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446290.918862:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789446290.918876:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789446290.918881:0:22809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:282408b2-7484-4ad3-93ba-27093493daa8+25:3657:x1876369794665472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789446290.918889:0:22809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789446290.918893:0:22809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2d35ea7000/0x62554ff374550853 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff37455084c expref: 25 pid: 22818 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.918901:0:22809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2d35ea7000/0x62554ff374550853 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x62554ff37455084c expref: 25 pid: 22818 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.918910:0:22809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789446290.918930:0:22809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:282408b2-7484-4ad3-93ba-27093493daa8+25:3657:x1876369794665472:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446290.918936:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789446290.918948:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789446290.918983:0:22809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:282408b2-7484-4ad3-93ba-27093493daa8+24:3659:x1876369794665600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789446290.918991:0:22809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789446290.918995:0:22809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2d36a50c00/0x62554ff374550814 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff37455080d expref: 24 pid: 22819 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.919004:0:22809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2d36a50c00/0x62554ff374550814 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x62554ff37455080d expref: 24 pid: 22819 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.919014:0:22809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789446290.919049:0:22809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:282408b2-7484-4ad3-93ba-27093493daa8+24:3659:x1876369794665600:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446290.919055:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789446290.919096:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:282408b2-7484-4ad3-93ba-27093493daa8:3659:1876369794665600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789446290.919118:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:282408b2-7484-4ad3-93ba-27093493daa8:3657:1876369794665472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789446290.919125:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:282408b2-7484-4ad3-93ba-27093493daa8:3657:1876369794665344:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789446290.919969:0:25852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d13ba6600/0x62554ff3745509d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x62554ff3745509cd expref: 23 pid: 22816 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446290.919986:0:25852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2a236300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1876369794664832:0@lo:104: 00010000:00010000:0.0:1789446290.919998:0:25852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d35ea7000/0x62554ff374550853 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x62554ff37455084c expref: 22 pid: 22818 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446290.920006:0:25852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2a235180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1876369794664960:0@lo:104: 00010000:00010000:0.0:1789446290.920015:0:25852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d36a50c00/0x62554ff374550814 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x62554ff37455080d expref: 21 pid: 22819 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446290.920023:0:25852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08062a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1876369794665088:0@lo:104: 00000100:00100000:3.0:1789446290.920669:0:22807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789446290.920687:0:22807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08f95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:282408b2-7484-4ad3-93ba-27093493daa8+4:25852:x1876369794665216:12345-0@lo:104: 00010000:00010000:3.0:1789446290.920702:0:22807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7200/0x62554ff3745507ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff374550806 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446290.920909:0:22807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789446290.920915:0:22807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08f95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:282408b2-7484-4ad3-93ba-27093493daa8+4:25852:x1876369794665216:12345-0@lo:104: Request processed in 238us (3307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446290.920929:0:22807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789446290.920974:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789446290.920980:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7200/0x62554ff3745507ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x62554ff374550806 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446290.920988:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d35ea7200 already unused, calling callback (ffffffffc14dec20) 10000000:00010000:3.0:1789446290.920992:0:22813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7200/0x62554ff3745507ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x62554ff374550806 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446290.921013:0:22813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7200/0x62554ff3745507ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x62554ff374550806 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789446290.921019:0:22813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7200/0x62554ff3745507ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x62554ff374550806 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789446290.921025:0:22813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789446290.921068:0:22813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7200/0x62554ff3745507ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff374550806 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446290.921075:0:22813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789446290.921092:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7200/0x62554ff3745507ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff374550806 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446290.921099:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9c2d35ea7200/0x62554ff3745507ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x62554ff374550806 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446290.921118:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446290.921120:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789446290.921122:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789446290.921141:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c081d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:282408b2-7484-4ad3-93ba-27093493daa8:3660:1876369794665728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789446290.921178:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446290.921230:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794665728 00000100:00100000:3.0:1789446290.921237:0:22809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794665728 00010000:00010000:3.0:1789446290.921258:0:22809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2d36806c00/0x62554ff374550806 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff3745507ff expref: 21 pid: 22816 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446290.921283:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789446290.921290:0:22809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c081d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:282408b2-7484-4ad3-93ba-27093493daa8+21:3660:x1876369794665728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789446290.921306:0:22809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789446290.921312:0:22809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2d36806c00/0x62554ff374550806 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x62554ff3745507ff expref: 21 pid: 22816 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446290.921321:0:22809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2d36806c00/0x62554ff374550806 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x62554ff3745507ff expref: 21 pid: 22816 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446290.921335:0:22809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789446290.921364:0:22809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c081d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:282408b2-7484-4ad3-93ba-27093493daa8+21:3660:x1876369794665728:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446290.921370:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789446290.921406:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c081d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:282408b2-7484-4ad3-93ba-27093493daa8:3660:1876369794665728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789446290.922178:0:22808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789446290.922377:0:25852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d36806c00/0x62554ff374550806 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x62554ff3745507ff expref: 20 pid: 22816 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446290.922390:0:25852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08f95180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1876369794665216:0@lo:104: 00000100:00100000:3.0:1789446290.926070:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446290.926175:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446290.926527:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773582976 00000100:00100000:1.0:1789446290.926536:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773582976 00010000:00010000:1.0:1789446290.926569:0:22810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2d13ba6200/0x62554ff374550b78 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65448 expref: 13 pid: 22819 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446290.926597:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773583104 00000100:00100000:1.0:1789446290.926599:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773583104 00010000:00010000:1.0:1789446290.926608:0:22810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2d13ba7600/0x62554ff374550b39 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a653d8 expref: 14 pid: 22818 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446290.926625:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:1.0:1789446290.926632:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c01743450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae38b160-8985-48da-9d2d-8e0f9518970b+14:2406:x1876369773582976:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789446290.926654:0:22810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789446290.926659:0:22810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9c2d13ba6200/0x62554ff374550b78 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65448 expref: 14 pid: 22819 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.926670:0:22810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2d13ba6200/0x62554ff374550b78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65448 expref: 14 pid: 22819 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.926685:0:22810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789446290.926730:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c01743450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae38b160-8985-48da-9d2d-8e0f9518970b+14:2406:x1876369773582976:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 98us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446290.926737:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:1.0:1789446290.926780:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:1.0:1789446290.926786:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c081d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae38b160-8985-48da-9d2d-8e0f9518970b+13:2406:x1876369773583104:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789446290.926791:0:22810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789446290.926795:0:22810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9c2d13ba7600/0x62554ff374550b39 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a653d8 expref: 13 pid: 22818 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.926808:0:22810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2d13ba7600/0x62554ff374550b39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a653d8 expref: 13 pid: 22818 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.926818:0:22810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550ba9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.926825:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550ba9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.926837:0:22810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550ba9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.926852:0:22810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550ba9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.926858:0:22810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550ba9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.926863:0:22810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550ba9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.926868:0:22810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36a51e00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:1.0:1789446290.926871:0:22810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550ba9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.926878:0:22810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550ba9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.926885:0:22810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550ba9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446290.926895:0:22810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789446290.926915:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c081d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae38b160-8985-48da-9d2d-8e0f9518970b+13:2406:x1876369773583104:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 129us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446290.926921:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00010000:00010000:2.0:1789446290.928942:0:25852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d13ba6200/0x62554ff374550b78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65448 expref: 12 pid: 22819 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446290.928977:0:25852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2a235500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1876369794664576:192.168.206.48@tcp:104: 00010000:00010000:2.0:1789446290.929010:0:25852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d13ba7600/0x62554ff374550b39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a653d8 expref: 11 pid: 22818 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446290.929021:0:25852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2a237480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25852:1876369794664704:192.168.206.48@tcp:104: 00010000:00010000:2.0:1789446290.929068:0:25852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550ba9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446290.929079:0:25852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550ba9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446290.929086:0:25852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550ba9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446290.929093:0:25852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2d36a51e00/0x62554ff374550ba9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446291.174212:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789446291.174234:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c081d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794665856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789446291.174304:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446291.174623:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2a236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1876369794666368:0@lo:400:kworker.0 00000100:00100000:2.0:1789446291.174657:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446291.174675:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1876369794666880:0@lo:400:kworker.0 00000100:00100000:2.0:1789446291.174715:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446291.174735:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1876369794667392:0@lo:400:kworker.0 00000100:00100000:2.0:1789446291.174757:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446291.174772:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789446291.174778:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2a237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:282408b2-7484-4ad3-93ba-27093493daa8:3657:1876369794665984:0@lo:400:kworker.0 00000100:00100000:2.0:1789446291.174817:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446291.174858:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d41b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1876369794666496:0@lo:400:kworker.0 00000100:00100000:2.0:1789446291.174881:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446291.174905:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1876369794667008:0@lo:400:kworker.0 00000100:00100000:2.0:1789446291.174926:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446291.174952:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794665984 00000100:00100000:2.0:1789446291.174978:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794665984 00000100:00100000:2.0:1789446291.175021:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789446291.175030:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+20:3657:x1876369794665984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446291.175084:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+20:3657:x1876369794665984:12345-0@lo:400:kworker.0 Request processed in 55us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446291.175091:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789446291.175146:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2a237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:282408b2-7484-4ad3-93ba-27093493daa8:3657:1876369794665984:0@lo:400:kworker.0 00000100:00100000:3.0:1789446291.177124:0:24333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794665856 00000100:00100000:3.0:1789446291.177138:0:24333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794665856 00000100:00100000:3.0:1789446291.177213:0:24333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789446291.177226:0:24333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08f94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794665856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789446291.177260:0:24333:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1789446291.177329:0:24333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08f94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1876369794665856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (3025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446291.177335:0:24333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789446291.177361:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2a235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794666112:0@lo:400:kworker.0 00000100:00100000:3.0:1789446291.177392:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446291.177415:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794666624:0@lo:400:kworker.0 00000100:00100000:3.0:1789446291.177437:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446291.177468:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1876369794667136:0@lo:400:kworker.0 00000100:00100000:3.0:1789446291.177494:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446291.177510:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789446291.177516:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d2a235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794666240:0@lo:400:kworker.0 00000100:00100000:3.0:1789446291.177540:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446291.177558:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794666752:0@lo:400:kworker.0 00000100:00100000:3.0:1789446291.177576:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446291.177594:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1876369794667264:0@lo:400:kworker.0 00000100:00100000:3.0:1789446291.177613:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446291.177638:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794666880 00000100:00100000:3.0:1789446291.177642:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794666880 00000100:00100000:3.0:1789446291.177663:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794667392 00000100:00100000:3.0:1789446291.177666:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794667392 00000100:00100000:3.0:1789446291.177679:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794666496 00000100:00100000:3.0:1789446291.177682:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794666496 00000100:00100000:3.0:1789446291.177692:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794667008 00000100:00100000:3.0:1789446291.177695:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794667008 00000100:00100000:3.0:1789446291.177706:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794667136 00000100:00100000:3.0:1789446291.177708:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794667136 00000100:00100000:3.0:1789446291.177719:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794667264 00000100:00100000:3.0:1789446291.177721:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794667264 00000100:00100000:3.0:1789446291.177734:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789446291.177741:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1876369794666880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446291.177780:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1876369794666880:12345-0@lo:400:kworker.0 Request processed in 39us (3064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446291.177786:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789446291.177798:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789446291.177805:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1876369794667392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446291.177846:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1876369794667392:12345-0@lo:400:kworker.0 Request processed in 42us (3087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446291.177852:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789446291.177865:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789446291.177871:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1876369794666496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446291.177898:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1876369794666496:12345-0@lo:400:kworker.0 Request processed in 27us (3016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446291.177904:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789446291.177915:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789446291.177921:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1876369794667008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446291.177949:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1876369794667008:12345-0@lo:400:kworker.0 Request processed in 29us (3022us total) trans 0 rc 0/0 00000100:00080000:0.0:1789446291.177980:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789446291.177986:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789446291.177989:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1789446291.177996:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789446291.178005:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789446291.178012:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c081d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876369794667136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446291.178034:0:24331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794666368 00000100:00100000:0.0:1789446291.178054:0:24331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794666368 00000100:00100000:3.0:1789446291.178065:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c081d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1876369794667136:12345-0@lo:400:kworker.0 Request processed in 52us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446291.178072:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789446291.178088:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789446291.178097:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c081d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876369794667264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446291.178097:0:24331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794666240 00000100:00100000:0.0:1789446291.178103:0:24331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794666240 00000100:00100000:3.0:1789446291.178132:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c081d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876369794667264:12345-0@lo:400:kworker.0 Request processed in 37us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446291.178133:0:24331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794666752 00000100:00100000:0.0:1789446291.178138:0:24331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794666752 00000100:00100000:3.0:1789446291.178142:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789446291.178163:0:24331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789446291.178170:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789446291.178174:0:24331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1876369794666368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446291.178183:0:24833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c081d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794666240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446291.178343:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1876369794667264:0@lo:400:kworker.0 00010000:00080000:2.0:1789446291.178357:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2c05a78e00 x1876369794667136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789446291.178367:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1876369794667136:0@lo:400:kworker.0 00000100:00100000:2.0:1789446291.178405:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794666112 00000100:00100000:2.0:1789446291.178409:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794666112 00000100:00100000:2.0:1789446291.178434:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794666624 00000100:00100000:2.0:1789446291.178437:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794666624 00000100:00100000:2.0:1789446291.178451:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789446291.178457:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c081d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794666112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789446291.178526:0:24833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c081d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794666240:12345-0@lo:400:kworker.0 Request processed in 347us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446291.178534:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789446291.178549:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789446291.178555:0:24833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c081d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794666752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446291.178580:0:24331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1876369794666368:12345-0@lo:400:kworker.0 Request processed in 408us (3920us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446291.178587:0:24331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789446291.178628:0:23565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789446291.178637:0:23565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c081d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794666624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446291.178653:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d39b98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1876369794667520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789446291.178684:0:23565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c081d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794666624:12345-0@lo:400:kworker.0 Request processed in 47us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446291.178691:0:23565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789446291.178697:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789446291.178711:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789446291.178716:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789446291.178741:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c081d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1876369794665856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789446291.178768:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d41b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1876369794666496:0@lo:400:kworker.0 00000100:00100000:0.0:1789446291.178783:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1876369794667008:0@lo:400:kworker.0 00000100:00100000:0.0:1789446291.178795:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2a236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1876369794666368:0@lo:400:kworker.0 00000100:00100000:0.0:1789446291.178819:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1876369794666880:0@lo:400:kworker.0 00010000:00080000:0.0:1789446291.178840:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2c05a7a680 x1876369794667392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446291.178849:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1876369794667392:0@lo:400:kworker.0 00000100:00100000:2.0:1789446291.180087:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c081d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794666112:12345-0@lo:400:kworker.0 Request processed in 1623us (2687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446291.180098:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789446291.180167:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2a235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794666240:0@lo:400:kworker.0 00000100:00100000:2.0:1789446291.180179:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d2a235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794666112:0@lo:400:kworker.0 00000100:00100000:2.0:1789446291.180203:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794666624:0@lo:400:kworker.0 00000100:00100000:2.0:1789446291.180239:0:24333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794667520 00000100:00100000:2.0:1789446291.180245:0:24333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794667520 00000100:00100000:2.0:1789446291.180294:0:24333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789446291.180302:0:24333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1876369794667520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789446291.180320:0:24333:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789446291.180371:0:24333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1876369794667520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (1675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446291.180378:0:24333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789446291.180605:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d39b98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1876369794667520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789446291.182157:0:24833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c081d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794666752:12345-0@lo:400:kworker.0 Request processed in 3595us (4572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446291.182170:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789446291.183083:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794666752:0@lo:400:kworker.0 00000040:00080000:0.0:1789446291.495119:0:23579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789446291.622279:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789446292.326081:0:22821:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789446292.326088:0:22821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c2c07a6f000 from 13 10000000:01000000:3.0:1789446292.326094:0:22821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789446292.326152:0:22821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36806800/0x62554ff374550bb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.326164:0:22821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d36806800/0x62554ff374550bb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.326175:0:22821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d36806800/0x62554ff374550bb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446292.326201:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c081d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794667648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789446292.326268:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446292.326322:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d07f55b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789446292.326374:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794667648 00000100:00100000:1.0:1789446292.326382:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794667648 00000100:00100000:1.0:1789446292.326436:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789446292.326446:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+20:22821:x1876369794667648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789446292.326458:0:22818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446292.326472:0:22818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d2fa9c000/0x62554ff374550bb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff374550bb0 expref: -99 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.326494:0:22818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d2fa9c000/0x62554ff374550bb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff374550bb0 expref: 21 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.326505:0:22818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d2fa9c000/0x62554ff374550bb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff374550bb0 expref: 21 pid: 22818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.326514:0:22818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d2fa9c000, rc 0) 00000100:00100000:1.0:1789446292.326560:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+21:22821:x1876369794667648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446292.326567:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789446292.326596:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c081d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794667648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789446292.326609:0:22821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d36806800/0x62554ff374550bb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550bb7 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.326618:0:22821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d36806800/0x62554ff374550bb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff374550bb7 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446292.326686:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c081d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794667776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789446292.326712:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446292.326738:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d07f55b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789446292.326755:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794667776 00000100:00100000:1.0:1789446292.326760:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794667776 00000100:00100000:1.0:1789446292.326793:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789446292.326799:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+21:22821:x1876369794667776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789446292.326940:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+21:22821:x1876369794667776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446292.326947:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789446292.327007:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c081d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794667776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789446292.327046:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c08f94380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794667904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789446292.327089:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446292.327137:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794667904 00000100:00100000:1.0:1789446292.327141:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794667904 00000100:00100000:0.0:1789446292.327148:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d086d5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789446292.327172:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789446292.327178:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+21:22821:x1876369794667904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789446292.327274:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+21:22821:x1876369794667904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446292.327281:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789446292.327363:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c08f94380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794667904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789446292.341817:0:25866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789446292.358457:0:22821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789446292.358495:0:22821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789446292.358509:0:22821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36806800/0x62554ff374550bb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550bb7 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.358521:0:22821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d36806800/0x62554ff374550bb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550bb7 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789446292.358532:0:22821:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789446292.358534:0:22821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c2d31d3f000 from 13 10000000:01000000:3.0:1789446292.358537:0:22821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789446292.358582:0:22821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff374550bbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.358591:0:22821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff374550bbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.358603:0:22821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff374550bbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446292.358629:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c081d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794668032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789446292.358693:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446292.358730:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d07f559c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789446292.359134:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794668032 00000100:00100000:1.0:1789446292.359143:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794668032 00000100:00100000:1.0:1789446292.359195:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789446292.359205:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+21:22821:x1876369794668032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789446292.359228:0:22819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446292.359242:0:22819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d2fa9c400/0x62554ff374550bc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff374550bbe expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.359266:0:22819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d2fa9c400/0x62554ff374550bc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff374550bbe expref: 22 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.359277:0:22819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d2fa9c400/0x62554ff374550bc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff374550bbe expref: 22 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.359286:0:22819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d2fa9c400, rc 0) 00000100:00100000:1.0:1789446292.359341:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+22:22821:x1876369794668032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446292.359348:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789446292.359494:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c081d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794668032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789446292.359510:0:22821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff374550bbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550bc5 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.359520:0:22821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff374550bbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff374550bc5 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446292.359582:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d39b9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794668160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789446292.359612:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446292.359644:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c07892480 going to sleep for 11 seconds 00000100:00100000:1.0:1789446292.360162:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794668160 00000100:00100000:1.0:1789446292.360169:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794668160 00000100:00100000:1.0:1789446292.360207:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789446292.360215:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+22:22821:x1876369794668160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789446292.360337:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+22:22821:x1876369794668160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446292.360360:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789446292.360509:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d39b9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794668160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789446292.360549:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d39b9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794668288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789446292.360590:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446292.360620:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c07892480 going to sleep for 11 seconds 00000100:00100000:2.0:1789446292.360640:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794668288 00000100:00100000:2.0:1789446292.360643:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794668288 00000100:00100000:2.0:1789446292.360664:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789446292.360670:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+22:22821:x1876369794668288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789446292.360758:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+22:22821:x1876369794668288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446292.360766:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789446292.360806:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d39b9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794668288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789446292.367537:0:25867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789446292.377063:0:22821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789446292.377108:0:22821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789446292.377121:0:22821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff374550bbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550bc5 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.377134:0:22821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d36807c00/0x62554ff374550bbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550bc5 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789446292.377145:0:22821:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789446292.377148:0:22821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c2d3fe3e000 from 13 10000000:01000000:2.0:1789446292.377150:0:22821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789446292.377188:0:22821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba7600/0x62554ff374550bcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.377196:0:22821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba7600/0x62554ff374550bcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.377207:0:22821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba7600/0x62554ff374550bcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446292.377576:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d39b9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794668416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789446292.378079:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446292.378123:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c07892480 going to sleep for 11 seconds 00000100:00100000:1.0:1789446292.378202:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794668416 00000100:00100000:1.0:1789446292.378210:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794668416 00000100:00100000:1.0:1789446292.378272:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789446292.378283:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+22:22821:x1876369794668416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789446292.378296:0:22819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446292.378312:0:22819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d2fa9d400/0x62554ff374550bd3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff374550bcc expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.378337:0:22819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d2fa9d400/0x62554ff374550bd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff374550bcc expref: 23 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.378348:0:22819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d2fa9d400/0x62554ff374550bd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff374550bcc expref: 23 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.378357:0:22819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d2fa9d400, rc 0) 00000100:00100000:1.0:1789446292.378408:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+23:22821:x1876369794668416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446292.378415:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789446292.378583:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d39b9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794668416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789446292.378601:0:22821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba7600/0x62554ff374550bcc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550bd3 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.378610:0:22821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba7600/0x62554ff374550bcc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff374550bd3 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446292.378677:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d39b9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794668544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789446292.378707:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446292.378731:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c07892480 going to sleep for 11 seconds 00000100:00100000:1.0:1789446292.379287:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794668544 00000100:00100000:1.0:1789446292.379295:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794668544 00000100:00100000:1.0:1789446292.379337:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789446292.379345:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d317e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+23:22821:x1876369794668544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789446292.379512:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d317e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+23:22821:x1876369794668544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446292.379519:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789446292.384535:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d39b9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794668544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789446292.384659:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c081d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794668672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789446292.384731:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446292.384765:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d07f55b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789446292.384843:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794668672 00000100:00100000:1.0:1789446292.384856:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794668672 00000100:00100000:1.0:1789446292.384919:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789446292.384927:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+23:22821:x1876369794668672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789446292.386350:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+23:22821:x1876369794668672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1416us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446292.386361:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789446292.388991:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c081d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794668672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789446292.413637:0:25868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789446292.413844:0:22821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789446292.413873:0:22821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789446292.413883:0:22821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba7600/0x62554ff374550bcc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550bd3 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.413896:0:22821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba7600/0x62554ff374550bcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550bd3 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789446292.413908:0:22821:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789446292.413911:0:22821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c2d41bbc000 from 13 10000000:01000000:2.0:1789446292.413913:0:22821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789446292.413947:0:22821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba6200/0x62554ff374550bda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.413994:0:22821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba6200/0x62554ff374550bda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.414020:0:22821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba6200/0x62554ff374550bda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446292.414056:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d39b98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794668800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789446292.414118:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446292.414156:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c07892d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789446292.415429:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794668800 00000100:00100000:1.0:1789446292.415439:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794668800 00000100:00100000:1.0:1789446292.415509:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789446292.415518:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+23:22821:x1876369794668800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789446292.415532:0:22819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446292.415549:0:22819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d2fa9c600/0x62554ff374550be1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x62554ff374550bda expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.415573:0:22819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d2fa9c600/0x62554ff374550be1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x62554ff374550bda expref: 24 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.415583:0:22819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d2fa9c600/0x62554ff374550be1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x62554ff374550bda expref: 24 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.415592:0:22819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d2fa9c600, rc 0) 00000100:00100000:1.0:1789446292.415658:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:282408b2-7484-4ad3-93ba-27093493daa8+24:22821:x1876369794668800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (1539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446292.415665:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789446292.415846:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d39b98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794668800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789446292.415863:0:22821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba6200/0x62554ff374550bda lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550be1 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.415873:0:22821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba6200/0x62554ff374550bda lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x62554ff374550be1 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446292.415942:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d39b98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794668928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789446292.416006:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446292.416046:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c07892d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789446292.416155:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794668928 00000100:00100000:1.0:1789446292.416160:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794668928 00000100:00100000:1.0:1789446292.416188:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789446292.416195:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+24:22821:x1876369794668928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789446292.416599:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:282408b2-7484-4ad3-93ba-27093493daa8+24:22821:x1876369794668928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 403us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446292.416607:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789446292.416670:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d39b98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794668928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789446292.416701:0:22821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d39b98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794669056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789446292.416737:0:22821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446292.416765:0:22821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c07892d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789446292.416809:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794669056 00000100:00100000:3.0:1789446292.416814:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794669056 00000100:00100000:3.0:1789446292.416846:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789446292.416853:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+24:22821:x1876369794669056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789446292.416936:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+24:22821:x1876369794669056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446292.416942:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789446292.417110:0:22821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d39b98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:282408b2-7484-4ad3-93ba-27093493daa8:22821:1876369794669056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789446292.417947:0:25869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789446292.418243:0:22821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789446292.418268:0:22821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789446292.418278:0:22821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba6200/0x62554ff374550bda lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550be1 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.418289:0:22821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9c2d13ba6200/0x62554ff374550bda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x62554ff374550be1 expref: -99 pid: 22821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446292.445195:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446292.445496:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773583232 00000100:00100000:2.0:1789446292.445507:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773583232 00000100:00100000:2.0:1789446292.445749:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 159 00000100:00100000:2.0:1789446292.445762:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+11:18095:x1876369773583232:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789446292.445796:0:22816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789446292.445819:0:22816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d13ba6400/0x62554ff374550be8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a65480 expref: -99 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.445855:0:22816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d13ba6400/0x62554ff374550be8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65480 expref: 12 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.445867:0:22816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d13ba6400/0x62554ff374550be8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65480 expref: 12 pid: 22816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.445877:0:22816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d13ba6400, rc 0) 00000100:00100000:2.0:1789446292.445948:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+12:18095:x1876369773583232:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 189us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446292.445989:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 159 00000100:00100000:0.0:1789446292.448302:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446292.448404:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773583360 00000100:00100000:2.0:1789446292.448414:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773583360 00000100:00100000:2.0:1789446292.448500:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 160 00000100:00100000:2.0:1789446292.448511:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+12:18095:x1876369773583360:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789446292.451952:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+12:18095:x1876369773583360:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 3433us (3649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446292.451979:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 160 00000100:00100000:0.0:1789446292.456205:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446292.456304:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773583488 00000100:00100000:2.0:1789446292.456315:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773583488 00000100:00100000:2.0:1789446292.456363:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 161 00000100:00100000:2.0:1789446292.456372:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+12:18095:x1876369773583488:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789446292.456538:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+12:18095:x1876369773583488:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 166us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446292.456553:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 161 00000100:00100000:0.0:1789446292.465107:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446292.465276:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773583616 00000100:00100000:2.0:1789446292.465286:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773583616 00000100:00100000:2.0:1789446292.465340:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 162 00000100:00100000:2.0:1789446292.465348:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+12:18095:x1876369773583616:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789446292.465364:0:22819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789446292.465380:0:22819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2d13ba6e00/0x62554ff374550bef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a65487 expref: -99 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.465406:0:22819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2d13ba6e00/0x62554ff374550bef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65487 expref: 13 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.465417:0:22819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2d13ba6e00/0x62554ff374550bef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65487 expref: 13 pid: 22819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.465427:0:22819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d13ba6e00, rc 0) 00000100:00100000:2.0:1789446292.465486:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+13:18095:x1876369773583616:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 139us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446292.465493:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 162 00000100:00100000:0.0:1789446292.477554:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446292.477659:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773583744 00000100:00100000:3.0:1789446292.477669:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773583744 00000100:00100000:3.0:1789446292.477724:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 163 00000100:00100000:3.0:1789446292.477735:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae38b160-8985-48da-9d2d-8e0f9518970b+13:18095:x1876369773583744:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789446292.477876:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae38b160-8985-48da-9d2d-8e0f9518970b+13:18095:x1876369773583744:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 142us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446292.477884:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 163 00000100:00100000:0.0:1789446292.484918:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446292.485071:0:22816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773583872 00000100:00100000:1.0:1789446292.485081:0:22816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773583872 00000100:00100000:1.0:1789446292.485133:0:22816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 164 00000100:00100000:1.0:1789446292.485143:0:22816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+13:18095:x1876369773583872:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789446292.485289:0:22816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae38b160-8985-48da-9d2d-8e0f9518970b+13:18095:x1876369773583872:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 146us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446292.485296:0:22816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 164 00000100:00100000:0.0:1789446292.583500:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446292.583608:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773584000 00000100:00100000:3.0:1789446292.583617:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773584000 00000100:00100000:3.0:1789446292.583698:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:3.0:1789446292.583711:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08f94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+6:18717:x1876369773584000:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789446292.583732:0:25435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446292.583754:0:25435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806c00/0x62554ff374550bf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a6548e expref: -99 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.583820:0:25435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806400/0x62554ff374550bfd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.583843:0:25435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806400/0x62554ff374550bfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.583858:0:25435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806400/0x62554ff374550bfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.583873:0:25435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807600/0x62554ff374550c04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.583879:0:25435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807600/0x62554ff374550c04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.583885:0:25435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807600/0x62554ff374550c04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.583995:0:25435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806200/0x62554ff374550c0b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.584003:0:25435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806200/0x62554ff374550c0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.584011:0:25435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806200/0x62554ff374550c0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789446292.584596:0:25435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789446292.584602:0:25435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789446292.584642:0:25435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806200/0x62554ff374550c0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.584654:0:25435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806400/0x62554ff374550bfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.584671:0:25435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806400/0x62554ff374550bfd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.584679:0:25435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806400/0x62554ff374550bfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.584685:0:25435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36806400 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:3.0:1789446292.584689:0:25435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806400/0x62554ff374550bfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.584696:0:25435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806400/0x62554ff374550bfd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.584709:0:25435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2d05f30d00) 00010000:00010000:3.0:1789446292.584712:0:25435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789446292.584717:0:25435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806400/0x62554ff374550bfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.584723:0:25435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806400/0x62554ff374550bfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.584737:0:25435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807600/0x62554ff374550c04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.584743:0:25435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807600/0x62554ff374550c04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.584749:0:25435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807600/0x62554ff374550c04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.584754:0:25435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36807600 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:3.0:1789446292.584764:0:25435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807600/0x62554ff374550c04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.584771:0:25435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807600/0x62554ff374550c04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.584780:0:25435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c2d130c0800) 00010000:00010000:3.0:1789446292.584783:0:25435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789446292.584786:0:25435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807600/0x62554ff374550c04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.584792:0:25435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807600/0x62554ff374550c04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.584829:0:25435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806c00/0x62554ff374550bf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6548e expref: 8 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.584843:0:25435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806200/0x62554ff374550c0b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6548e expref: 7 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.584850:0:25435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c2d130c0c00) 00010000:00010000:3.0:1789446292.584852:0:25435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789446292.584855:0:25435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d36806200, rc 0) 00000100:00100000:3.0:1789446292.584917:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08f94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+7:18717:x1876369773584000:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 1209us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446292.584925:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00080000:0.0:1789446292.585155:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789446292.591052:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446292.591159:0:22836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773584128 00000100:00100000:1.0:1789446292.591169:0:22836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773584128 00000100:00100000:1.0:1789446292.591227:0:22836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:1.0:1789446292.591238:0:22836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08f96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a97a55b2-7974-4297-b5cb-8884d980fe73+7:18717:x1876369773584128:12345-192.168.206.48@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789446292.591320:0:22836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08f96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a97a55b2-7974-4297-b5cb-8884d980fe73+7:18717:x1876369773584128:12345-192.168.206.48@tcp:900:lhsmtool_posix.0 Request processed in 84us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446292.591341:0:22836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:2.0:1789446292.604093:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446292.604191:0:22825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773584384 00000100:00100000:1.0:1789446292.604201:0:22825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773584384 00000100:00100000:1.0:1789446292.604317:0:22825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:1.0:1789446292.604328:0:22825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+7:18717:x1876369773584384:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789446292.604349:0:22825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446292.604367:0:22825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550c12 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a65495 expref: -99 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.604500:0:22825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c19 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.604515:0:22825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.604527:0:22825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.604540:0:22825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c20 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.604547:0:22825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.604553:0:22825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.604656:0:22825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9c800/0x62554ff374550c27 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.604681:0:22825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9c800/0x62554ff374550c27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.604687:0:22825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9c800/0x62554ff374550c27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789446292.604697:0:22825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1789446292.604839:0:22825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.604846:0:22825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c19 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.604853:0:22825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c19 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.604858:0:22825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9cc00 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:1.0:1789446292.604862:0:22825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c19 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.604870:0:22825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c19 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.604881:0:22825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c2d130c0c00) 00010000:00010000:1.0:1789446292.604884:0:22825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446292.604889:0:22825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c19 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.604895:0:22825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c19 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.604907:0:22825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.604919:0:22825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c20 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.604925:0:22825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c20 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.604930:0:22825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9dc00 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:1.0:1789446292.604933:0:22825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c20 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.604939:0:22825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c20 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.604947:0:22825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c2d013e7200) 00010000:00010000:1.0:1789446292.604950:0:22825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446292.604953:0:22825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c20 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.605889:0:22825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c20 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.606716:0:22825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550c12 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65495 expref: 10 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.606736:0:22825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9c800/0x62554ff374550c27 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65495 expref: 9 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.606744:0:22825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c2d013e7400) 00010000:00010000:1.0:1789446292.606747:0:22825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446292.606756:0:22825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d2fa9c800, rc 0) 00000100:00100000:1.0:1789446292.606828:0:22825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+9:18717:x1876369773584384:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 2501us (2745us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1789446292.606836:0:22825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:0.0:1789446292.619703:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446292.619846:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773584512 00000100:00100000:3.0:1789446292.619856:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773584512 00000100:00100000:3.0:1789446292.620158:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:3.0:1789446292.620170:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08f94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+9:18717:x1876369773584512:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789446292.621342:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08f94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+9:18717:x1876369773584512:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 Request processed in 1168us (1641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446292.621354:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:2.0:1789446292.631203:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446292.631357:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773584640 00000100:00100000:1.0:1789446292.631366:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773584640 00000100:00100000:1.0:1789446292.631544:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:1.0:1789446292.631555:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+5:18717:x1876369773584640:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1789446292.635091:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1789446292.636150:0:22826:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4555us 00010000:00010000:2.0:1789446292.646747:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789446292.660620:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+5:18717:x1876369773584640:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 Request processed in 29054us (29413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446292.660635:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:2.0:1789446292.667907:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446292.668167:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773584768 00000100:00100000:1.0:1789446292.668178:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773584768 00000100:00100000:1.0:1789446292.668235:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:1.0:1789446292.668255:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+9:18723:x1876369773584768:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1789446292.668275:0:22824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446292.668295:0:22824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550c35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a6549c expref: -99 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.668355:0:22824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.668370:0:22824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.668392:0:22824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.668580:0:22824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.668601:0:22824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.668609:0:22824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.668653:0:22824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.668660:0:22824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c3c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.668667:0:22824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.668673:0:22824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9dc00 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:1.0:1789446292.668677:0:22824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.668685:0:22824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.668696:0:22824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2d05f30d00) 00010000:00010000:1.0:1789446292.668699:0:22824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446292.668703:0:22824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.668710:0:22824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.668723:0:22824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.668735:0:22824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.668740:0:22824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.668746:0:22824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9cc00 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:1.0:1789446292.668749:0:22824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.668756:0:22824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.668764:0:22824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c2d013e7200) 00010000:00010000:1.0:1789446292.668766:0:22824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446292.668769:0:22824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c43 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.668774:0:22824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.668807:0:22824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550c35 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6549c expref: 10 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.668817:0:22824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2d05f30d00) 00010000:00010000:1.0:1789446292.668819:0:22824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446292.668823:0:22824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550c35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6549c expref: 10 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.668845:0:22824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d2fa9ca00, rc 0) 00000100:00100000:1.0:1789446292.669053:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+9:18723:x1876369773584768:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 798us (1154us total) trans 0 rc 301/301 00000100:00100000:1.0:1789446292.669062:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:0.0:1789446292.687131:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446292.687355:0:22833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773584896 00000100:00100000:3.0:1789446292.687364:0:22833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773584896 00000100:00100000:3.0:1789446292.687426:0:22833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:3.0:1789446292.687441:0:22833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08f95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a97a55b2-7974-4297-b5cb-8884d980fe73+9:18723:x1876369773584896:12345-192.168.206.48@tcp:700:lfs.0 00000100:00100000:3.0:1789446292.687527:0:22833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08f95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a97a55b2-7974-4297-b5cb-8884d980fe73+9:18723:x1876369773584896:12345-192.168.206.48@tcp:700:lfs.0 Request processed in 92us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446292.687535:0:22833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:0.0:1789446292.692948:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446292.693157:0:22825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773585152 00000100:00100000:2.0:1789446292.693166:0:22825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773585152 00000100:00100000:2.0:1789446292.693317:0:22825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:2.0:1789446292.693328:0:22825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08f97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+9:18723:x1876369773585152:12345-192.168.206.48@tcp:36:lfs.0 00010000:00010000:2.0:1789446292.693410:0:22825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789446292.693436:0:22825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9de00/0x62554ff374550b63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65409 expref: 9 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.693462:0:22825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2d05f30d00) 00010000:00010000:2.0:1789446292.693467:0:22825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789446292.693726:0:22825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6a00/0x62554ff374550c4a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.693740:0:22825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7000/0x62554ff374550ba2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65479 expref: 5 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.693748:0:22825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6a00/0x62554ff374550c4a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.693780:0:22825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7000/0x62554ff374550ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65479 expref: 5 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.693795:0:22825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7000/0x62554ff374550ba2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65479 expref: 5 pid: 25435 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446292.693808:0:22825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d39b9b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22825:1876369794669184:192.168.206.48@tcp:104: 00000100:00100000:2.0:1789446292.693951:0:22825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c07892c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789446292.698230:0:22825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d39b9b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22825:1876369794669184:192.168.206.48@tcp:104: 00010000:00010000:2.0:1789446292.698272:0:22825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6a00/0x62554ff374550c4a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446292.699142:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446292.699236:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773585280 00000100:00100000:1.0:1789446292.699255:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773585280 00010000:00010000:1.0:1789446292.699313:0:22810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7000/0x62554ff374550ba2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65479 expref: 6 pid: 25435 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446292.699355:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:1.0:1789446292.699365:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08f95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:2407:x1876369773585280:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789446292.699378:0:22810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789446292.699396:0:22810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7000/0x62554ff374550ba2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65479 expref: 6 pid: 25435 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.699409:0:22810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7000/0x62554ff374550ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65479 expref: 6 pid: 25435 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.699430:0:22810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7000/0x62554ff374550ba2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65479 expref: 6 pid: 25435 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.699455:0:22810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2d05f30d00) 00010000:00010000:1.0:1789446292.699460:0:22810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6a00/0x62554ff374550c4a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.699469:0:22810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6a00/0x62554ff374550c4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.699492:0:22810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6a00/0x62554ff374550c4a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.699519:0:22810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789446292.699573:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08f95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+5:2407:x1876369773585280:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 210us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446292.699581:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00010000:00010000:3.0:1789446292.699916:0:22825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6a00/0x62554ff374550c4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.699924:0:22825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6a00/0x62554ff374550c4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.699949:0:22825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806c00/0x62554ff374550c51 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.699977:0:22825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806c00/0x62554ff374550c51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.699986:0:22825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806c00/0x62554ff374550c51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789446292.700648:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789446292.707663:0:22825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807600/0x62554ff374550c58 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.707695:0:22825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807600/0x62554ff374550c58 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.707706:0:22825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807600/0x62554ff374550c58 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789446292.707725:0:22825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000176977aa reply state 00000000c5646a5b transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807600/0x62554ff374550c58 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.707736:0:22825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807600/0x62554ff374550c58 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.707743:0:22825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c2d130c0b00) 00010000:00010000:3.0:1789446292.707746:0:22825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789446292.707750:0:22825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789446292.707755:0:22825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789446292.707764:0:22825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6a00/0x62554ff374550c4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.707771:0:22825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6a00/0x62554ff374550c4a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.707778:0:22825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6a00/0x62554ff374550c4a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.707784:0:22825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d13ba6a00 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:3.0:1789446292.707788:0:22825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6a00/0x62554ff374550c4a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.707795:0:22825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6a00/0x62554ff374550c4a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.707816:0:22825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2d05f30d00) 00010000:00010000:3.0:1789446292.707819:0:22825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789446292.707823:0:22825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6a00/0x62554ff374550c4a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.707829:0:22825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6a00/0x62554ff374550c4a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789446292.707848:0:22825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000176977aa reply state 00000000c5646a5b transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806c00/0x62554ff374550c51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.709638:0:22825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806c00/0x62554ff374550c51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.709648:0:22825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c2d130c0800) 00010000:00010000:3.0:1789446292.709650:0:22825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789446292.709655:0:22825:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789446292.714258:0:22825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08f97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+10:18723:x1876369773585152:12345-192.168.206.48@tcp:36:lfs.0 Request processed in 20911us (21298us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1789446292.714284:0:22825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:0.0:1789446292.841162:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446292.841278:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773585408 00000100:00100000:1.0:1789446292.841288:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773585408 00000100:00100000:1.0:1789446292.841345:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:1.0:1789446292.841355:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08f97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+10:18731:x1876369773585408:12345-192.168.206.48@tcp:101:lctl.0 00010000:00010000:1.0:1789446292.841385:0:22824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446292.841407:0:22824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a654a3 expref: -99 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.841469:0:22824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.841484:0:22824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.841495:0:22824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789446292.841535:0:22824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789446292.841540:0:22824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789446292.841577:0:22824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.841620:0:22824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654a3 expref: 12 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.841637:0:22824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9dc00/0x62554ff374550c66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654a3 expref: 11 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.841645:0:22824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2d013e7200) 00010000:00010000:1.0:1789446292.841648:0:22824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789446292.841652:0:22824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d2fa9dc00, rc 0) 00000100:00100000:1.0:1789446292.841713:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08f97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+11:18731:x1876369773585408:12345-192.168.206.48@tcp:101:lctl.0 Request processed in 359us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446292.841721:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:0.0:1789446292.880020:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446292.880381:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773585536 00000100:00100000:1.0:1789446292.880391:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773585536 00000100:00100000:1.0:1789446292.880468:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:1.0:1789446292.880478:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08f97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+5:18732:x1876369773585536:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1789446292.880497:0:22826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446292.880515:0:22826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a654aa expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.880576:0:22826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d000/0x62554ff374550c74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.880588:0:22826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d000/0x62554ff374550c74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.880599:0:22826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d000/0x62554ff374550c74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789446292.880651:0:22826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789446292.880655:0:22826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789446292.880676:0:22826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d000/0x62554ff374550c74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.880701:0:22826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654aa expref: 7 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.880718:0:22826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d000/0x62554ff374550c74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654aa expref: 6 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.880727:0:22826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2d013e7200) 00010000:00010000:1.0:1789446292.880730:0:22826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789446292.880733:0:22826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d2fa9d000, rc 0) 00000100:00100000:1.0:1789446292.880799:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08f97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:18732:x1876369773585536:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 322us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446292.880806:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:0.0:1789446292.888841:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446292.889049:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773585664 00000100:00100000:1.0:1789446292.889059:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773585664 00000100:00100000:1.0:1789446292.889169:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:1.0:1789446292.889181:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08f96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+6:18732:x1876369773585664:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1789446292.889202:0:22824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446292.889222:0:22824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a654b1 expref: -99 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889281:0:22824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d800/0x62554ff374550c82 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889312:0:22824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d800/0x62554ff374550c82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889324:0:22824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d800/0x62554ff374550c82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889336:0:22824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550c89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889343:0:22824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550c89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889350:0:22824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550c89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889448:0:22824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550c90 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889457:0:22824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550c90 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889464:0:22824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550c90 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789446292.889498:0:22824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789446292.889502:0:22824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789446292.889520:0:22824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550c90 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889531:0:22824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d800/0x62554ff374550c82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889547:0:22824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d800/0x62554ff374550c82 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889552:0:22824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d800/0x62554ff374550c82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889557:0:22824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9d800 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:1.0:1789446292.889561:0:22824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d800/0x62554ff374550c82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889568:0:22824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d800/0x62554ff374550c82 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889581:0:22824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2d013e7200) 00010000:00010000:1.0:1789446292.889584:0:22824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446292.889588:0:22824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d800/0x62554ff374550c82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889593:0:22824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d800/0x62554ff374550c82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889607:0:22824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550c89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889613:0:22824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550c89 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889618:0:22824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550c89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889623:0:22824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9ce00 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:1.0:1789446292.889632:0:22824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550c89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889638:0:22824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550c89 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889646:0:22824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c2d130c0800) 00010000:00010000:1.0:1789446292.889648:0:22824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446292.889651:0:22824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550c89 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889656:0:22824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550c89 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889681:0:22824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550c7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654b1 expref: 8 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889694:0:22824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550c90 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654b1 expref: 7 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.889701:0:22824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c2d130c0b00) 00010000:00010000:1.0:1789446292.889703:0:22824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789446292.889706:0:22824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d2fa9d600, rc 0) 00000100:00100000:1.0:1789446292.890081:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08f96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+7:18732:x1876369773585664:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 901us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446292.890089:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:0.0:1789446292.894158:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446292.894230:0:22836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773585792 00000100:00100000:1.0:1789446292.894239:0:22836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773585792 00000100:00100000:1.0:1789446292.894309:0:22836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:1.0:1789446292.894319:0:22836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08f94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+5:18732:x1876369773585792:12345-192.168.206.48@tcp:900:lfs.0 00000100:00080000:0.0:1789446292.894366:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789446292.894415:0:22836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08f94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+5:18732:x1876369773585792:12345-192.168.206.48@tcp:900:lfs.0 Request processed in 97us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446292.894424:0:22836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:0.0:1789446292.898064:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446292.898216:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773586048 00000100:00100000:1.0:1789446292.898228:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773586048 00000100:00100000:1.0:1789446292.898319:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:1.0:1789446292.898332:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08f96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+7:18732:x1876369773586048:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1789446292.898357:0:22826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446292.898377:0:22826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550c97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a654b8 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789446292.898541:0:22826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789446292.898638:0:22826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550c97 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654b8 expref: 9 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.898651:0:22826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2d013e7200) 00010000:00010000:1.0:1789446292.898654:0:22826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789446292.898659:0:22826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550c97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654b8 expref: 9 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446292.898741:0:22826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d2fa9d200, rc 0) 00000100:00100000:1.0:1789446292.898845:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08f96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+8:18732:x1876369773586048:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 515us (788us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1789446292.898852:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:0.0:1789446292.903140:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446292.903225:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773586304 00000100:00100000:3.0:1789446292.903242:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773586304 00000100:00100000:3.0:1789446292.903292:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:3.0:1789446292.903301:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08f94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+8:18732:x1876369773586304:12345-192.168.206.48@tcp:36:lfs.0 00010000:00010000:3.0:1789446292.903347:0:25435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789446292.903371:0:25435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550c90 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654b1 expref: 8 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.903389:0:25435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c2d130c0b00) 00010000:00010000:3.0:1789446292.903393:0:25435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789446292.903415:0:25435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806400/0x62554ff374550ca5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.903459:0:25435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806400/0x62554ff374550ca5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.903470:0:25435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806400/0x62554ff374550ca5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789446292.903692:0:25435:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6b245fc reply state 00000000d3954702 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806400/0x62554ff374550ca5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.903704:0:25435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806400/0x62554ff374550ca5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.903711:0:25435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c2d130c0b00) 00010000:00010000:3.0:1789446292.903713:0:25435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1789446292.903716:0:25435:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789446292.903723:0:25435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789446292.903805:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08f94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+9:18732:x1876369773586304:12345-192.168.206.48@tcp:36:lfs.0 Request processed in 505us (673us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1789446292.903812:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:0.0:1789446292.908860:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446292.909016:0:22827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773586560 00000100:00100000:3.0:1789446292.909025:0:22827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773586560 00000100:00100000:3.0:1789446292.909087:0:22827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:3.0:1789446292.909097:0:22827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08f97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+9:18732:x1876369773586560:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:3.0:1789446292.909308:0:22827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08f97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+10:18732:x1876369773586560:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 212us (457us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1789446292.909315:0:22827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:0.0:1789446292.916096:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446292.916200:0:22825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773586816 00000100:00100000:2.0:1789446292.916210:0:22825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773586816 00000100:00100000:2.0:1789446292.916275:0:22825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:2.0:1789446292.916286:0:22825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08f95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+10:18732:x1876369773586816:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1789446292.916308:0:22825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789446292.916327:0:22825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6c00/0x62554ff374550cac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a654bf expref: -99 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.916400:0:22825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7800/0x62554ff374550cb3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.916414:0:22825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7800/0x62554ff374550cb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.916424:0:22825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7800/0x62554ff374550cb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.916596:0:22825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7400/0x62554ff374550cba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.916606:0:22825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7400/0x62554ff374550cba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.916614:0:22825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7400/0x62554ff374550cba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789446292.916713:0:22825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789446292.916788:0:22825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7800/0x62554ff374550cb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.916813:0:22825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7800/0x62554ff374550cb3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.916819:0:22825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7800/0x62554ff374550cb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.916826:0:22825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d13ba7800 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:2.0:1789446292.916830:0:22825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7800/0x62554ff374550cb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.916839:0:22825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7800/0x62554ff374550cb3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.916851:0:22825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2d013e7200) 00010000:00010000:2.0:1789446292.916854:0:22825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789446292.916858:0:22825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7800/0x62554ff374550cb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.916864:0:22825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7800/0x62554ff374550cb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.916876:0:22825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7400/0x62554ff374550cba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.916882:0:22825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7400/0x62554ff374550cba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.916887:0:22825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7400/0x62554ff374550cba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.916892:0:22825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d13ba7400 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:2.0:1789446292.916901:0:22825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7400/0x62554ff374550cba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.916907:0:22825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7400/0x62554ff374550cba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.916915:0:22825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c2d130c0800) 00010000:00010000:2.0:1789446292.916917:0:22825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789446292.916920:0:22825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7400/0x62554ff374550cba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.916925:0:22825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba7400/0x62554ff374550cba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.918540:0:22825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6c00/0x62554ff374550cac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654bf expref: 12 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.918558:0:22825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2d013e7200) 00010000:00010000:2.0:1789446292.918561:0:22825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789446292.918567:0:22825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6c00/0x62554ff374550cac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654bf expref: 12 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446292.918582:0:22825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d13ba6c00, rc 0) 00000100:00100000:2.0:1789446292.918652:0:22825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08f95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+11:18732:x1876369773586816:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 2367us (2564us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1789446292.918661:0:22825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:0.0:1789446292.925002:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446292.925083:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773586944 00000100:00100000:3.0:1789446292.925094:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773586944 00000100:00100000:3.0:1789446292.925171:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:3.0:1789446292.925182:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c08f95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+11:18732:x1876369773586944:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789446292.925216:0:25435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446292.925234:0:25435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807e00/0x62554ff374550cc8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a654c6 expref: -99 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.925322:0:25435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550ccf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.925335:0:25435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550ccf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.925347:0:25435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550ccf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789446292.925389:0:25435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789446292.925393:0:25435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789446292.925507:0:25435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550ccf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.925535:0:25435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807e00/0x62554ff374550cc8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654c6 expref: 13 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.925552:0:25435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550ccf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654c6 expref: 12 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446292.925560:0:25435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c2d130c0b00) 00010000:00010000:3.0:1789446292.925562:0:25435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789446292.925566:0:25435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d00030000, rc 0) 00000100:00100000:3.0:1789446292.925669:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c08f95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+12:18732:x1876369773586944:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 488us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446292.925683:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:0.0:1789446292.932234:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446292.932338:0:22827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773587072 00000100:00100000:3.0:1789446292.932347:0:22827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773587072 00000100:00100000:3.0:1789446292.932416:0:22827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:3.0:1789446292.932427:0:22827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+12:18732:x1876369773587072:12345-192.168.206.48@tcp:37:lfs.0 00000100:00100000:2.0:1789446292.941056:0:22827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+12:18732:x1876369773587072:12345-192.168.206.48@tcp:37:lfs.0 Request processed in 8621us (8819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446292.941075:0:22827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:0.0:1789446292.946090:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446292.946201:0:22828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773587328 00000100:00100000:1.0:1789446292.946211:0:22828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773587328 00000100:00100000:1.0:1789446292.946276:0:22828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:1.0:1789446292.946298:0:22828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b58450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+12:18732:x1876369773587328:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:1.0:1789446292.946703:0:22828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b58450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+13:18732:x1876369773587328:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 406us (621us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1789446292.946711:0:22828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00000040:00080000:1.0:1789446292.967172:0:22862:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789446293.006753:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446293.006868:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773587456 00000100:00100000:1.0:1789446293.006877:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773587456 00000100:00100000:1.0:1789446293.006936:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:1.0:1789446293.006981:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d41b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+11:18738:x1876369773587456:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1789446293.007000:0:22826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446293.007019:0:22826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550cd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a654cd expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007089:0:22826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550cdd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007102:0:22826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550cdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007114:0:22826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550cdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007124:0:22826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550ce4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007130:0:22826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007137:0:22826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007223:0:22826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d800/0x62554ff374550ceb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007232:0:22826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d800/0x62554ff374550ceb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007254:0:22826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d800/0x62554ff374550ceb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789446293.007286:0:22826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789446293.007290:0:22826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789446293.007329:0:22826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d800/0x62554ff374550ceb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007341:0:22826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550cdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007347:0:22826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550cdd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007353:0:22826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550cdd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007359:0:22826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9cc00 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:1.0:1789446293.007363:0:22826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550cdd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007371:0:22826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550cdd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007392:0:22826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2d013e7200) 00010000:00010000:1.0:1789446293.007401:0:22826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446293.007407:0:22826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550cdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007413:0:22826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550cdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007427:0:22826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007433:0:22826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550ce4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007438:0:22826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550ce4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007443:0:22826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9ce00 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:1.0:1789446293.007446:0:22826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550ce4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007452:0:22826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550ce4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007460:0:22826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c2d130c0800) 00010000:00010000:1.0:1789446293.007463:0:22826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446293.007466:0:22826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550ce4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007472:0:22826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550ce4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007498:0:22826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550cd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654cd expref: 13 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007525:0:22826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d800/0x62554ff374550ceb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654cd expref: 12 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.007533:0:22826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c2d130c0b00) 00010000:00010000:1.0:1789446293.007535:0:22826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789446293.007537:0:22826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d2fa9d800, rc 0) 00000100:00100000:1.0:1789446293.007603:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d41b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+12:18738:x1876369773587456:12345-192.168.206.48@tcp:101:bash.0 Request processed in 648us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446293.007611:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:0.0:1789446293.013926:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446293.014165:0:22836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773587584 00000100:00100000:1.0:1789446293.014175:0:22836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773587584 00000100:00100000:1.0:1789446293.014232:0:22836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:1.0:1789446293.014252:0:22836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a97a55b2-7974-4297-b5cb-8884d980fe73+5:18738:x1876369773587584:12345-192.168.206.48@tcp:900:bash.0 00000100:00100000:1.0:1789446293.014333:0:22836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a97a55b2-7974-4297-b5cb-8884d980fe73+5:18738:x1876369773587584:12345-192.168.206.48@tcp:900:bash.0 Request processed in 84us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446293.014341:0:22836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:0.0:1789446293.017111:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446293.017214:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773587840 00000100:00100000:1.0:1789446293.017224:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773587840 00000100:00100000:1.0:1789446293.017288:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:1.0:1789446293.017297:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+12:18738:x1876369773587840:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1789446293.017313:0:22824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446293.017332:0:22824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550cf2 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a654d4 expref: -99 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.017558:0:22824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550cf9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.017585:0:22824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550ccf lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654c6 expref: 12 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.017593:0:22824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550cf9 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.017627:0:22824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550ccf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654c6 expref: 12 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.017640:0:22824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550ccf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654c6 expref: 12 pid: 25435 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446293.017653:0:22824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22824:1876369794669312:192.168.206.48@tcp:104: 00000100:00100000:1.0:1789446293.017734:0:22824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d2fac7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789446293.020574:0:22824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22824:1876369794669312:192.168.206.48@tcp:104: 00010000:00010000:1.0:1789446293.020602:0:22824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550cf9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446293.022087:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446293.022399:0:23578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773587968 00000100:00100000:3.0:1789446293.022408:0:23578:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773587968 00010000:00010000:3.0:1789446293.022448:0:23578:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550ccf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654c6 expref: 13 pid: 25435 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446293.022488:0:23578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:3.0:1789446293.022498:0:23578:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39bb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+13:2407:x1876369773587968:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789446293.022512:0:23578:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789446293.022518:0:23578:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550ccf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654c6 expref: 13 pid: 25435 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.022531:0:23578:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550ccf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654c6 expref: 13 pid: 25435 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.022552:0:23578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550ccf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654c6 expref: 13 pid: 25435 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.022569:0:23578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c2d130c0b00) 00010000:00010000:3.0:1789446293.022575:0:23578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550cf9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.022584:0:23578:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550cf9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.022605:0:23578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550cf9 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.022637:0:23578:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789446293.022694:0:23578:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39bb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+12:2407:x1876369773587968:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 197us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446293.022701:0:23578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 16 00010000:00010000:0.0:1789446293.023112:0:22824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550cf9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.023122:0:22824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550cf9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.023216:0:22824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51c00/0x62554ff374550d00 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.023226:0:22824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51c00/0x62554ff374550d00 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.023234:0:22824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51c00/0x62554ff374550d00 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.023756:0:22824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50800/0x62554ff374550d07 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.023767:0:22824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50800/0x62554ff374550d07 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.023783:0:22824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50800/0x62554ff374550d07 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789446293.023795:0:22824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789446293.023822:0:22824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550cf9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.023830:0:22824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550cf9 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.023836:0:22824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550cf9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.023842:0:22824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9ce00 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:0.0:1789446293.023846:0:22824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550cf9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.023854:0:22824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550cf9 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.023864:0:22824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c2d130c0b00) 00010000:00010000:0.0:1789446293.023867:0:22824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789446293.023871:0:22824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550cf9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.023877:0:22824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550cf9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789446293.023889:0:22824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000310795ee reply state 00000000b116acd6 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51c00/0x62554ff374550d00 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.023911:0:22824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51c00/0x62554ff374550d00 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.023918:0:22824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9c2d02f24c00) 00010000:00010000:0.0:1789446293.023921:0:22824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789446293.023924:0:22824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789446293.024065:0:22824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550cf2 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654d4 expref: 15 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.024082:0:22824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50800/0x62554ff374550d07 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654d4 expref: 14 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.024089:0:22824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:0.0:1789446293.024091:0:22824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789446293.024093:0:22824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d36a50800, rc 0) 00000100:00100000:0.0:1789446293.024149:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+15:18738:x1876369773587840:12345-192.168.206.48@tcp:101:bash.0 Request processed in 6853us (7047us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1789446293.024157:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:0.0:1789446293.046409:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446293.046532:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773588096 00000100:00100000:1.0:1789446293.046542:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773588096 00000100:00100000:1.0:1789446293.046611:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:1.0:1789446293.046622:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+15:18738:x1876369773588096:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1789446293.046642:0:22826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446293.046660:0:22826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550d15 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a654db expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.046748:0:22826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550d1c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.046760:0:22826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550d1c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.046771:0:22826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550d1c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789446293.046827:0:22826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789446293.046831:0:22826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789446293.046849:0:22826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550d1c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.046859:0:22826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550d1c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.046883:0:22826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550d15 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654db expref: 17 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.046898:0:22826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550d1c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654db expref: 16 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.046905:0:22826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:1.0:1789446293.046908:0:22826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789446293.046911:0:22826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d2fa9da00, rc 0) 00000100:00100000:1.0:1789446293.048298:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+16:18738:x1876369773588096:12345-192.168.206.48@tcp:101:bash.0 Request processed in 1669us (1888us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446293.048308:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:2.0:1789446293.053098:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446293.055367:0:22828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773588352 00000100:00100000:1.0:1789446293.055381:0:22828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773588352 00000100:00100000:1.0:1789446293.055565:0:22828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:1.0:1789446293.055576:0:22828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+16:18738:x1876369773588352:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:1.0:1789446293.056273:0:22828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+17:18738:x1876369773588352:12345-192.168.206.48@tcp:35:bash.0 Request processed in 609us (3093us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1789446293.056284:0:22828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:2.0:1789446293.212067:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446293.212208:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773588608 00000100:00100000:3.0:1789446293.212217:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773588608 00000100:00100000:3.0:1789446293.212334:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:3.0:1789446293.212345:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+17:18749:x1876369773588608:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789446293.212368:0:25435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446293.212388:0:25435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550d23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a654e2 expref: -99 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789446293.212477:0:25435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789446293.212567:0:25435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550d23 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654e2 expref: 19 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.212579:0:25435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2d013e7200) 00010000:00010000:3.0:1789446293.212582:0:25435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789446293.212587:0:25435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550d23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654e2 expref: 19 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.212601:0:25435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d00030000, rc 0) 00000100:00100000:3.0:1789446293.212660:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+18:18749:x1876369773588608:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 318us (602us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1789446293.212682:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:0.0:1789446293.216560:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446293.216843:0:22828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773588864 00000100:00100000:1.0:1789446293.216853:0:22828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773588864 00000100:00100000:1.0:1789446293.216911:0:22828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:1.0:1789446293.216922:0:22828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+18:18749:x1876369773588864:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:0.0:1789446293.217477:0:22828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+19:18749:x1876369773588864:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 553us (922us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1789446293.217490:0:22828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:2.0:1789446293.292177:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446293.292403:0:22825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773589120 00000100:00100000:3.0:1789446293.292416:0:22825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773589120 00000100:00100000:3.0:1789446293.292495:0:22825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:3.0:1789446293.292507:0:22825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+19:18752:x1876369773589120:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789446293.292538:0:22825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446293.292564:0:22825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550d31 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a654e9 expref: -99 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.292724:0:22825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00031200/0x62554ff374550d38 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.292744:0:22825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00031200/0x62554ff374550d38 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.292759:0:22825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00031200/0x62554ff374550d38 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789446293.292773:0:22825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789446293.292903:0:22825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550d31 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654e9 expref: 22 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.292926:0:22825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00031200/0x62554ff374550d38 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654e9 expref: 21 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.292936:0:22825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:3.0:1789446293.292939:0:22825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789446293.292943:0:22825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d00031200, rc 0) 00000100:00100000:3.0:1789446293.293106:0:22825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+21:18752:x1876369773589120:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 600us (944us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1789446293.293116:0:22825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:2.0:1789446293.304277:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446293.304467:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773589248 00000100:00100000:1.0:1789446293.304478:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773589248 00000100:00100000:1.0:1789446293.304551:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:1.0:1789446293.304562:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+21:2405:x1876369773589248:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789446293.304579:0:22810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789446293.304604:0:22810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00031200/0x62554ff374550d38 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654e9 expref: 21 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.304622:0:22810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:1.0:1789446293.304628:0:22810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789446293.304686:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+20:2405:x1876369773589248:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 127us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446293.304694:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:1.0:1789446293.314121:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446293.314287:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773589376 00000100:00100000:0.0:1789446293.314296:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773589376 00000100:00100000:0.0:1789446293.314369:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:0.0:1789446293.314378:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+20:18752:x1876369773589376:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:0.0:1789446293.314451:0:22824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550d46 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.314473:0:22824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550d46 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.314486:0:22824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550d46 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.314517:0:22824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550d46 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.314524:0:22824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550d46 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.314530:0:22824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550d46 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.314535:0:22824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36a50c00 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:0.0:1789446293.314539:0:22824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550d46 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.314545:0:22824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550d46 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.314557:0:22824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:0.0:1789446293.314560:0:22824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789446293.314564:0:22824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550d46 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.314570:0:22824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550d46 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446293.314654:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+20:18752:x1876369773589376:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 276us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446293.314661:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:3.0:1789446293.316296:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446293.316356:0:22827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773589632 00000100:00100000:2.0:1789446293.316365:0:22827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773589632 00000100:00100000:2.0:1789446293.316414:0:22827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:2.0:1789446293.316422:0:22827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c081d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+20:18752:x1876369773589632:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1789446293.316616:0:22827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c081d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+21:18752:x1876369773589632:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 194us (327us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1789446293.316624:0:22827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000040:00080000:0.0:1789446293.547469:0:23579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789446293.596002:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446293.596060:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446293.596080:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446293.596112:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446293.596135:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446293.596217:0:24331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773590016 00000100:00100000:0.0:1789446293.596228:0:24331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773590016 00000100:00100000:0.0:1789446293.596297:0:24331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773590272 00000100:00100000:0.0:1789446293.596300:0:24331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773590272 00000100:00100000:0.0:1789446293.596314:0:24331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773589888 00000100:00100000:0.0:1789446293.596317:0:24331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773589888 00000100:00100000:0.0:1789446293.596329:0:24331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773590144 00000100:00100000:0.0:1789446293.596331:0:24331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773590144 00000100:00100000:0.0:1789446293.596347:0:24331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:0.0:1789446293.596356:0:24331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+5:2404:x1876369773590016:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789446293.596424:0:24331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+5:2404:x1876369773590016:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 68us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446293.596431:0:24331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:0.0:1789446293.596446:0:24331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:0.0:1789446293.596452:0:24331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+5:2404:x1876369773590272:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789446293.596477:0:24331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+5:2404:x1876369773590272:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 24us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446293.596483:0:24331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:0.0:1789446293.596495:0:24331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:0.0:1789446293.596501:0:24331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+5:2404:x1876369773589888:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789446293.596521:0:24331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+5:2404:x1876369773589888:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 21us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446293.596538:0:24331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:0.0:1789446293.596549:0:24331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:0.0:1789446293.596587:0:24331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+5:2404:x1876369773590144:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789446293.596612:0:24331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:79ee354c-8e5b-496d-a1d3-11b6cf01e70d+5:2404:x1876369773590144:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 57us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446293.596617:0:24331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00080000:2.0:1789446293.597253:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789446293.597260:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789446293.597439:0:22819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773589760 00000100:00100000:1.0:1789446293.597455:0:22819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773589760 00000100:00100000:1.0:1789446293.597502:0:22819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 165 00000100:00100000:1.0:1789446293.597510:0:22819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+13:2404:x1876369773589760:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789446293.597560:0:22819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae38b160-8985-48da-9d2d-8e0f9518970b+13:2404:x1876369773589760:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 51us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446293.597577:0:22819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 165 00000100:00100000:2.0:1789446293.665620:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446293.665728:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773590528 00000100:00100000:1.0:1789446293.665737:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773590528 00000100:00100000:1.0:1789446293.665840:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:1.0:1789446293.665851:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+21:18783:x1876369773590528:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:1.0:1789446293.665876:0:22826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446293.665899:0:22826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550d4d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a654f0 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.666079:0:22826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550d54 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.666094:0:22826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550d54 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.666105:0:22826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550d54 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789446293.666116:0:22826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789446293.666443:0:22826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550d4d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654f0 expref: 24 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.666463:0:22826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550d54 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654f0 expref: 23 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.666571:0:22826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:1.0:1789446293.666574:0:22826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789446293.666578:0:22826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d2fa9ce00, rc 0) 00000100:00100000:1.0:1789446293.666698:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+23:18783:x1876369773590528:12345-192.168.206.48@tcp:101:cat.0 Request processed in 848us (1085us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1789446293.666706:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:3.0:1789446293.677443:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446293.677500:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446293.677738:0:23578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773590912 00000100:00100000:3.0:1789446293.677748:0:23578:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773590912 00000100:00100000:3.0:1789446293.677830:0:23578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:3.0:1789446293.677844:0:23578:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c081d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+23:2405:x1876369773590912:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789446293.677859:0:23578:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789446293.677886:0:23578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550d54 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654f0 expref: 23 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.677908:0:23578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:3.0:1789446293.677914:0:23578:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789446293.678670:0:23578:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c081d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+22:2405:x1876369773590912:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 824us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446293.678681:0:23578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 1 00010000:00010000:0.0:1789446293.678883:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789446293.679156:0:22827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773590784 00000100:00100000:2.0:1789446293.679165:0:22827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773590784 00000100:00100000:2.0:1789446293.679709:0:22827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:2.0:1789446293.679721:0:22827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c081d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+22:18783:x1876369773590784:12345-192.168.206.48@tcp:35:cat.0 00000100:00100000:2.0:1789446293.680227:0:22827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c081d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+23:18783:x1876369773590784:12345-192.168.206.48@tcp:35:cat.0 Request processed in 507us (2793us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1789446293.680237:0:22827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:1.0:1789446293.757590:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446293.757688:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773591168 00000100:00100000:0.0:1789446293.757698:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773591168 00000100:00100000:0.0:1789446293.757758:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:0.0:1789446293.757768:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+23:18789:x1876369773591168:12345-192.168.206.48@tcp:101:dd.0 00010000:00010000:0.0:1789446293.757792:0:22824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789446293.757813:0:22824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550d62 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a654f7 expref: -99 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.757912:0:22824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51e00/0x62554ff374550d69 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.757926:0:22824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50800/0x62554ff374550d07 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654d4 expref: 24 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.757935:0:22824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550d1c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654db expref: 24 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.757953:0:22824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51e00/0x62554ff374550d69 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.758042:0:22824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550d1c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654db expref: 24 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.758056:0:22824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550d1c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654db expref: 24 pid: 22826 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446293.758069:0:22824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d39bb0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22824:1876369794669440:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789446293.758180:0:22824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50800/0x62554ff374550d07 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654d4 expref: 24 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.758190:0:22824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50800/0x62554ff374550d07 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654d4 expref: 24 pid: 22824 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446293.758199:0:22824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d39bb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22824:1876369794669568:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789446293.758413:0:22824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d086d5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789446293.763677:0:22824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d39bb0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22824:1876369794669440:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789446293.763704:0:22824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d39bb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22824:1876369794669568:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789446293.763731:0:22824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51e00/0x62554ff374550d69 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446293.764675:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446293.764772:0:22810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773591296 00000100:00100000:0.0:1789446293.764781:0:22810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773591296 00010000:00010000:0.0:1789446293.764817:0:22810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550d1c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654db expref: 25 pid: 22826 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446293.764859:0:22810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:0.0:1789446293.764883:0:22810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+25:2406:x1876369773591296:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789446293.764898:0:22810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789446293.765078:0:22810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550d1c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654db expref: 25 pid: 22826 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.765091:0:22810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550d1c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654db expref: 25 pid: 22826 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.765110:0:22810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550d1c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654db expref: 25 pid: 22826 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.765208:0:22810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:0.0:1789446293.765327:0:22810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51e00/0x62554ff374550d69 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.765337:0:22810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51e00/0x62554ff374550d69 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.765344:0:22810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789446293.765401:0:22810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+24:2406:x1876369773591296:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 519us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446293.765409:0:22810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:3.0:1789446293.765626:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446293.765709:0:23578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773591424 00000100:00100000:0.0:1789446293.765715:0:23578:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773591424 00010000:00010000:0.0:1789446293.765733:0:23578:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50800/0x62554ff374550d07 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654d4 expref: 24 pid: 22824 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446293.765760:0:23578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:0.0:1789446293.765778:0:23578:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c01740c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+24:2407:x1876369773591424:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789446293.765788:0:23578:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789446293.765794:0:23578:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50800/0x62554ff374550d07 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654d4 expref: 24 pid: 22824 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.765804:0:23578:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50800/0x62554ff374550d07 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654d4 expref: 24 pid: 22824 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.765817:0:23578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50800/0x62554ff374550d07 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654d4 expref: 24 pid: 22824 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.765828:0:23578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:0.0:1789446293.765831:0:23578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51e00/0x62554ff374550d69 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.765838:0:23578:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51e00/0x62554ff374550d69 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.765844:0:23578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51e00/0x62554ff374550d69 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.765874:0:23578:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789446293.766151:0:22824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51e00/0x62554ff374550d69 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.766161:0:22824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51e00/0x62554ff374550d69 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789446293.766179:0:22824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789446293.766340:0:22824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550d62 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654f7 expref: 25 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.766368:0:22824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51e00/0x62554ff374550d69 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654f7 expref: 24 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.766376:0:22824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:1.0:1789446293.766379:0:22824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789446293.766382:0:22824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d36a51e00, rc 0) 00000100:00100000:0.0:1789446293.766581:0:23578:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c01740c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+24:2407:x1876369773591424:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 803us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446293.766619:0:23578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:1.0:1789446293.766784:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+23:18789:x1876369773591168:12345-192.168.206.48@tcp:101:dd.0 Request processed in 9017us (9203us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1789446293.766791:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:2.0:1789446293.769568:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446293.769657:0:22825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773591552 00000100:00100000:3.0:1789446293.769667:0:22825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773591552 00000100:00100000:3.0:1789446293.769744:0:22825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:3.0:1789446293.769755:0:22825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+23:18789:x1876369773591552:12345-192.168.206.48@tcp:101:dd.0 00010000:00010000:3.0:1789446293.769780:0:22825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446293.769799:0:22825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00031200/0x62554ff374550d77 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a654fe expref: -99 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.769846:0:22825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550d7e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.769858:0:22825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550d7e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.769869:0:22825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550d7e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.770204:0:22825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00031200/0x62554ff374550d77 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654fe expref: 25 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.770224:0:22825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550d7e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654fe expref: 24 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.770232:0:22825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:3.0:1789446293.770288:0:22825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789446293.770293:0:22825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d00030000, rc 0) 00000100:00100000:3.0:1789446293.770355:0:22825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+24:18789:x1876369773591552:12345-192.168.206.48@tcp:101:dd.0 Request processed in 603us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446293.770363:0:22825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:2.0:1789446293.773776:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446293.773890:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773591808 00000100:00100000:3.0:1789446293.773900:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773591808 00000100:00100000:1.0:1789446293.774293:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:1.0:1789446293.774308:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+24:18789:x1876369773591808:12345-192.168.206.48@tcp:36:dd.0 00010000:00010000:1.0:1789446293.774636:0:22824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550d85 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.774655:0:22824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550d85 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.774666:0:22824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550d85 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789446293.774705:0:22824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:1.0:1789446293.774729:0:22824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2f35961 reply state 00000000871164fb transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550d85 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.774739:0:22824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550d85 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.774746:0:22824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:1.0:1789446293.774749:0:22824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789446293.774753:0:22824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789446293.774845:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+27:18789:x1876369773591808:12345-192.168.206.48@tcp:36:dd.0 Request processed in 539us (1088us total) trans 12884901906 rc 0/0 00000100:00100000:1.0:1789446293.774852:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 45 00000020:00080000:1.0:1789446293.774856:0:22824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789446293.777188:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446293.777298:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773591936 00000100:00100000:1.0:1789446293.777308:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773591936 00000100:00100000:1.0:1789446293.777410:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:1.0:1789446293.777421:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+27:18789:x1876369773591936:12345-192.168.206.48@tcp:101:dd.0 00010000:00010000:1.0:1789446293.777442:0:22826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446293.777472:0:22826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550d8c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a65505 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.777524:0:22826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550d8c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65505 expref: 28 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.777538:0:22826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550d8c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65505 expref: 28 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446293.777555:0:22826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:1.0:1789446293.777558:0:22826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789446293.777562:0:22826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d2fa9d600, rc 0) 00000100:00100000:1.0:1789446293.777616:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+28:18789:x1876369773591936:12345-192.168.206.48@tcp:101:dd.0 Request processed in 196us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446293.777622:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:2.0:1789446293.799508:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446293.799605:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773592192 00000100:00100000:0.0:1789446293.799616:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773592192 00000100:00100000:0.0:1789446293.799683:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:0.0:1789446293.799694:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+28:18789:x1876369773592192:12345-192.168.206.48@tcp:103:dd.0 00010000:00010000:0.0:1789446293.799720:0:22811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789446293.799744:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550d8c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65505 expref: 28 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446293.799764:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:0.0:1789446293.799768:0:22811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789446293.799825:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+27:18789:x1876369773592192:12345-192.168.206.48@tcp:103:dd.0 Request processed in 133us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446293.799833:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:2.0:1789446293.805328:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446293.805409:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773592320 00000100:00100000:3.0:1789446293.805419:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773592320 00000100:00100000:3.0:1789446293.805483:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:3.0:1789446293.805494:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+27:18789:x1876369773592320:12345-192.168.206.48@tcp:58:dd.0 00010000:00010000:3.0:1789446293.805599:0:25435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00031200/0x62554ff374550d93 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.805628:0:25435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00031200/0x62554ff374550d93 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.805639:0:25435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00031200/0x62554ff374550d93 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789446293.809150:0:25435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789446293.809227:0:25435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1789446293.809534:0:25435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1789446293.809711:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+27:18789:x1876369773592320:12345-192.168.206.48@tcp:58:dd.0 Request processed in 4213us (4387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446293.809724:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:2.0:1789446293.814546:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446293.814632:0:22825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773592448 00000100:00100000:3.0:1789446293.814642:0:22825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773592448 00000100:00100000:3.0:1789446293.814754:0:22825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:3.0:1789446293.814765:0:22825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+27:18789:x1876369773592448:12345-192.168.206.48@tcp:101:dd.0 00010000:00010000:3.0:1789446293.814786:0:22825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446293.814808:0:22825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807e00/0x62554ff374550d9a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a6550c expref: -99 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.814871:0:22825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00031200/0x62554ff374550d93 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.814882:0:22825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807e00/0x62554ff374550d9a lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6550c expref: 28 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.814901:0:22825:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00031200/0x62554ff374550d93 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.814942:0:22825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807e00/0x62554ff374550d9a lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6550c expref: 28 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.814991:0:22825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:3.0:1789446293.814995:0:22825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789446293.815000:0:22825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807e00/0x62554ff374550d9a lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6550c expref: 28 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446293.815008:0:22825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d36807e00, rc 0) 00000100:00100000:3.0:1789446293.815077:0:22825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+28:18789:x1876369773592448:12345-192.168.206.48@tcp:101:dd.0 Request processed in 313us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446293.815083:0:22825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 48 00000040:00080000:2.0:1789446293.990235:0:22862:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789446293.990244:0:22862:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789446293.990286:0:22862:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1789446293.990295:0:22862:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1789446293.990504:0:22862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c05a79f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22862:1876369794669696:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789446293.990595:0:22862:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d3d0996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789446294.001427:0:22862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c05a79f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22862:1876369794669696:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789446294.012083:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446294.012316:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773592576 00000100:00100000:0.0:1789446294.012326:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773592576 00000100:00100000:0.0:1789446294.012399:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:0.0:1789446294.012410:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+28:18791:x1876369773592576:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789446294.012438:0:22824:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789446294.012554:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+28:18791:x1876369773592576:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 145us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446294.012561:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00080000:2.0:1789446294.013272:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789446294.043158:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446294.043763:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773592704 00000100:00100000:1.0:1789446294.043775:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773592704 00000100:00100000:1.0:1789446294.043842:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:1.0:1789446294.043852:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+28:18791:x1876369773592704:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789446294.043921:0:22826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550da1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.043937:0:22826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550da1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.043950:0:22826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550da1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044073:0:22826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9de00/0x62554ff374550da8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044083:0:22826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9de00/0x62554ff374550da8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044091:0:22826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9de00/0x62554ff374550da8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044152:0:22826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550daf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044162:0:22826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550daf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044170:0:22826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550daf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789446294.044212:0:22826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789446294.044217:0:22826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789446294.044229:0:22826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550daf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044239:0:22826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550da1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044246:0:22826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550da1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044253:0:22826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550da1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044269:0:22826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9ca00 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:1.0:1789446294.044273:0:22826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550da1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044281:0:22826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550da1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044293:0:22826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c2d013e7400) 00010000:00010000:1.0:1789446294.044296:0:22826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446294.044301:0:22826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550da1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044307:0:22826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550da1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044319:0:22826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9de00/0x62554ff374550da8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044325:0:22826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9de00/0x62554ff374550da8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044330:0:22826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9de00/0x62554ff374550da8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044335:0:22826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9de00 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:1.0:1789446294.044337:0:22826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9de00/0x62554ff374550da8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044342:0:22826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9de00/0x62554ff374550da8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044360:0:22826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9c2d013e7700) 00010000:00010000:1.0:1789446294.044363:0:22826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446294.044366:0:22826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9de00/0x62554ff374550da8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044371:0:22826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9de00/0x62554ff374550da8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044384:0:22826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550daf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044390:0:22826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550daf lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044395:0:22826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550daf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044399:0:22826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9d600 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:1.0:1789446294.044402:0:22826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550daf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044407:0:22826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550daf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044414:0:22826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:1.0:1789446294.044416:0:22826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446294.044419:0:22826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550daf lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.044423:0:22826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550daf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446294.044516:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+28:18791:x1876369773592704:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 Request processed in 663us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446294.044523:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:0.0:1789446294.051281:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446294.051472:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773592960 00000100:00100000:1.0:1789446294.051481:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773592960 00000100:00100000:1.0:1789446294.051534:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:1.0:1789446294.051545:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39bb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+28:18791:x1876369773592960:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789446294.051564:0:22824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446294.051585:0:22824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550db6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a65513 expref: -99 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.051681:0:22824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550dbd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.051695:0:22824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550dbd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.051706:0:22824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550dbd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789446294.051717:0:22824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789446294.051786:0:22824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550dbd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.051795:0:22824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550dbd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.051801:0:22824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550dbd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.051823:0:22824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9ce00 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:1.0:1789446294.051827:0:22824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550dbd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.051835:0:22824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550dbd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.051847:0:22824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:1.0:1789446294.051850:0:22824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789446294.051855:0:22824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550dbd lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.051862:0:22824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550dbd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.051902:0:22824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550db6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65513 expref: 30 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.051912:0:22824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c2d013e7400) 00010000:00010000:1.0:1789446294.051914:0:22824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789446294.051917:0:22824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550db6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65513 expref: 30 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.051926:0:22824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d2fa9da00, rc 0) 00000100:00100000:1.0:1789446294.052006:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39bb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+29:18791:x1876369773592960:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 463us (734us total) trans 12884901907 rc 301/301 00000100:00100000:1.0:1789446294.052014:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:2.0:1789446294.058148:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446294.058229:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773593088 00000100:00100000:1.0:1789446294.058251:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773593088 00000100:00100000:1.0:1789446294.058311:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:1.0:1789446294.058321:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+29:18791:x1876369773593088:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789446294.058359:0:22826:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789446294.058474:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+29:18791:x1876369773593088:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 154us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446294.058483:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:2.0:1789446294.073726:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446294.073823:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773593344 00000100:00100000:1.0:1789446294.073834:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773593344 00000100:00100000:1.0:1789446294.073895:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:1.0:1789446294.073907:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c05a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+29:18791:x1876369773593344:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789446294.073929:0:22824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446294.073951:0:22824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550dcb lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a6551a expref: -99 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789446294.074358:0:22824:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:1.0:1789446294.074364:0:22824:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:1.0:1789446294.074382:0:22824:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:1.0:1789446294.074517:0:22824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550dd2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.074531:0:22824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550dd2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.074541:0:22824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550dd2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.074593:0:22824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550dcb lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6551a expref: 32 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.074629:0:22824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550dd2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6551a expref: 31 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.074636:0:22824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c2d013e7700) 00010000:00010000:1.0:1789446294.074640:0:22824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789446294.074643:0:22824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d2fa9ce00, rc 0) 00000100:00100000:1.0:1789446294.074698:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c05a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+31:18791:x1876369773593344:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 795us (983us total) trans 12884901908 rc 0/0 00000100:00100000:1.0:1789446294.074706:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:0.0:1789446294.087442:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446294.087544:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773593600 00000100:00100000:1.0:1789446294.087553:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773593600 00000100:00100000:1.0:1789446294.087629:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 54 00000100:00100000:1.0:1789446294.087640:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39bb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+31:18791:x1876369773593600:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789446294.087696:0:22826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789446294.087723:0:22826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ce00/0x62554ff374550dd2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6551a expref: 31 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.087741:0:22826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c2d013e7700) 00010000:00010000:1.0:1789446294.087751:0:22826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789446294.087771:0:22826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550de0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.087784:0:22826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550de0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.087793:0:22826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550de0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.087839:0:22826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550de7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb093fe5f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.087847:0:22826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550de7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb093fe5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.087854:0:22826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550de7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb093fe5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.087894:0:22826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550de0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.087901:0:22826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550de0 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.087908:0:22826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550de0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.087914:0:22826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9da00 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:1.0:1789446294.087918:0:22826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550de0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.087926:0:22826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550de0 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.087934:0:22826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c2d130c0b00) 00010000:00010000:1.0:1789446294.087936:0:22826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446294.087940:0:22826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550de0 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.087945:0:22826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550de0 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.088012:0:22826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550de7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb093fe5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.088019:0:22826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550de7 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb093fe5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.088035:0:22826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550de7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb093fe5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.088040:0:22826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9d600 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:1.0:1789446294.088043:0:22826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550de7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb093fe5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.088049:0:22826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550de7 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb093fe5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.088057:0:22826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb093fe5f (ffff9c2d18a5c000) 00010000:00010000:1.0:1789446294.088059:0:22826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789446294.088062:0:22826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550de7 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb093fe5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.088069:0:22826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550de7 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb093fe5f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446294.088151:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39bb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+30:18791:x1876369773593600:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 513us (718us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789446294.088159:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 54 00000100:00100000:2.0:1789446294.100859:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446294.100948:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773593728 00000100:00100000:1.0:1789446294.100989:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773593728 00000100:00100000:1.0:1789446294.101046:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:1.0:1789446294.101071:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+30:18791:x1876369773593728:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789446294.101091:0:22824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446294.101113:0:22824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550dee lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a65521 expref: -99 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.101147:0:22824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550df5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.101160:0:22824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550df5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.101170:0:22824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550df5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.101281:0:22824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550dee lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65521 expref: 32 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.101300:0:22824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9da00/0x62554ff374550df5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65521 expref: 31 pid: 22824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.101308:0:22824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c2d18a5c000) 00010000:00010000:1.0:1789446294.101311:0:22824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789446294.101314:0:22824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d2fa9da00, rc 0) 00000100:00100000:1.0:1789446294.102084:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+31:18791:x1876369773593728:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 311us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446294.102094:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:2.0:1789446294.106638:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446294.106720:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773593984 00000100:00100000:1.0:1789446294.106729:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773593984 00000100:00100000:1.0:1789446294.106788:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:1.0:1789446294.106810:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+31:18791:x1876369773593984:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789446294.106886:0:22826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550dfc lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.106903:0:22826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550dfc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.106916:0:22826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550dfc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789446294.107120:0:22826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:1.0:1789446294.107131:0:22826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676181173290ns, next at 677181170535ns, rc = 0 00000004:00010000:1.0:1789446294.107180:0:22826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9aedca8 reply state 00000000dff9f790 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550dfc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.107192:0:22826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550dfc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.107199:0:22826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c2d18a5c000) 00010000:00010000:1.0:1789446294.107203:0:22826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789446294.107206:0:22826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789446294.107307:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+33:18791:x1876369773593984:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 498us (677us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1789446294.107315:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:3.0:1789446294.111942:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446294.112207:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773594112 00000100:00100000:0.0:1789446294.112217:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773594112 00000100:00100000:0.0:1789446294.112276:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:0.0:1789446294.112287:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c081d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+33:18791:x1876369773594112:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789446294.112311:0:25435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789446294.112331:0:25435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51800/0x62554ff374550e03 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a65528 expref: -99 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.112417:0:25435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51800/0x62554ff374550e03 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65528 expref: 34 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.112432:0:25435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51800/0x62554ff374550e03 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65528 expref: 34 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.112451:0:25435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c2d18a5c000) 00010000:00010000:0.0:1789446294.112455:0:25435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789446294.112458:0:25435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d36a51800, rc 0) 00000100:00100000:0.0:1789446294.112522:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c081d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+34:18791:x1876369773594112:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 238us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446294.112530:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:2.0:1789446294.130686:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446294.130915:0:24331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773594240 00000100:00100000:0.0:1789446294.130925:0:24331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773594240 00000100:00100000:0.0:1789446294.131011:0:24331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:0.0:1789446294.131031:0:24331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a235180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+5:2404:x1876369773594240:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789446294.131464:0:24331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a235180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+6:2404:x1876369773594240:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 443us (785us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1789446294.131473:0:24331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:2.0:1789446294.155759:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446294.157301:0:22828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773594496 00000100:00100000:0.0:1789446294.157313:0:22828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773594496 00000100:00100000:2.0:1789446294.157531:0:22827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:2.0:1789446294.157544:0:22827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+34:18791:x1876369773594496:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789446294.157771:0:22827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+35:18791:x1876369773594496:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 230us (2021us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1789446294.157778:0:22827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:3.0:1789446294.163550:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446294.163881:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773594752 00000100:00100000:1.0:1789446294.163891:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773594752 00000100:00100000:1.0:1789446294.163994:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:1.0:1789446294.164005:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c081d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+35:18791:x1876369773594752:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789446294.164120:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c081d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+35:18791:x1876369773594752:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 117us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446294.164150:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:1.0:1789446294.169294:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446294.169396:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773594880 00000100:00100000:0.0:1789446294.169405:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773594880 00000100:00100000:0.0:1789446294.169458:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00100000:0.0:1789446294.169468:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+35:18791:x1876369773594880:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789446294.169499:0:25435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789446294.169519:0:25435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50800/0x62554ff374550e0a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a6552f expref: -99 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.169584:0:25435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550e11 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.169600:0:25435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550e11 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.169612:0:25435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550e11 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789446294.169653:0:25435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789446294.169673:0:25435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550e11 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.169698:0:25435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50800/0x62554ff374550e0a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6552f expref: 37 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.169715:0:25435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550e11 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6552f expref: 36 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.169723:0:25435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c2d18a5c000) 00010000:00010000:0.0:1789446294.169726:0:25435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789446294.169730:0:25435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d36a50c00, rc 0) 00000100:00100000:0.0:1789446294.169793:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+36:18791:x1876369773594880:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 326us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446294.169800:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00100000:2.0:1789446294.182821:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446294.182953:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773595008 00000100:00100000:3.0:1789446294.183000:0:24833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773595008 00000100:00100000:3.0:1789446294.183068:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:3.0:1789446294.183078:0:24833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d2a237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+6:2405:x1876369773595008:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789446294.183097:0:24833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789446294.183117:0:24833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e18 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a65536 expref: -99 pid: 24833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789446294.183227:0:24833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa8c895, blocks: 0x0 00010000:00010000:3.0:1789446294.183315:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=676s v=(0 0) 00010000:00010000:3.0:1789446294.183320:0:24833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789446294.183344:0:24833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65536 expref: 7 pid: 24833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.183366:0:24833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65536 expref: 7 pid: 24833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.183505:0:24833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d39b60000, rc 0) 00000100:00100000:3.0:1789446294.183698:0:24833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d2a237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+7:2405:x1876369773595008:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 619us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446294.183706:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:3.0:1789446294.191158:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446294.191261:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773595264 00000100:00100000:1.0:1789446294.191271:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773595264 00000100:00100000:1.0:1789446294.191331:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:1.0:1789446294.191341:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c081d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+36:18791:x1876369773595264:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789446294.191475:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c081d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+36:18791:x1876369773595264:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 134us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446294.191483:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:2.0:1789446294.207728:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446294.207824:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773595392 00000100:00100000:0.0:1789446294.207834:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773595392 00000100:00100000:0.0:1789446294.207892:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:0.0:1789446294.207902:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+36:18791:x1876369773595392:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789446294.212128:0:22804:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:2.0:1789446294.212152:0:22804:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1789446294.212207:0:22804:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:3.0:1789446294.212812:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806400/0x62554ff374550ca5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.212826:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806400/0x62554ff374550ca5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.212834:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806400/0x62554ff374550ca5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.212840:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36806400 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:3.0:1789446294.212846:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806400/0x62554ff374550ca5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.212855:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806400/0x62554ff374550ca5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.212871:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c2d130c0b00) 00010000:00010000:3.0:1789446294.212875:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789446294.212892:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806400/0x62554ff374550ca5 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.212899:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806400/0x62554ff374550ca5 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213004:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806c00/0x62554ff374550c51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213012:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806c00/0x62554ff374550c51 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213018:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806c00/0x62554ff374550c51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213034:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36806c00 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:0.0:1789446294.213037:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806c00/0x62554ff374550c51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213044:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806c00/0x62554ff374550c51 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213053:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c2d130c0800) 00010000:00010000:0.0:1789446294.213056:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789446294.213059:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806c00/0x62554ff374550c51 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213065:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36806c00/0x62554ff374550c51 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213083:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807600/0x62554ff374550c58 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213099:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807600/0x62554ff374550c58 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213105:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807600/0x62554ff374550c58 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213110:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36807600 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:0.0:1789446294.213113:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807600/0x62554ff374550c58 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213119:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807600/0x62554ff374550c58 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213128:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c2d130c0b00) 00010000:00010000:0.0:1789446294.213130:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789446294.213143:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807600/0x62554ff374550c58 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213149:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807600/0x62554ff374550c58 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213163:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51c00/0x62554ff374550d00 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213169:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51c00/0x62554ff374550d00 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213174:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51c00/0x62554ff374550d00 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213179:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36a51c00 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:0.0:1789446294.213187:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51c00/0x62554ff374550d00 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213193:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51c00/0x62554ff374550d00 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213201:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9c2d02f24c00) 00010000:00010000:0.0:1789446294.213204:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789446294.213207:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51c00/0x62554ff374550d00 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213213:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51c00/0x62554ff374550d00 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213229:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550d85 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213246:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550d85 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213252:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550d85 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213257:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9d200 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:0.0:1789446294.213259:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550d85 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213265:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550d85 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213272:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:0.0:1789446294.213275:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789446294.213284:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550d85 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213290:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550d85 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213303:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550dfc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213309:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550dfc lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213314:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550dfc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213319:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9d600 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:0.0:1789446294.213321:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550dfc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213327:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550dfc lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213334:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c2d18a5c000) 00010000:00010000:0.0:1789446294.213335:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789446294.213338:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550dfc lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.213344:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550dfc lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446294.213486:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+15:18791:x1876369773595392:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 Request processed in 5580us (5761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446294.213495:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:2.0:1789446294.214924:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794669824:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789446294.215010:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446294.215120:0:24332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794669824 00000100:00100000:3.0:1789446294.215127:0:24332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794669824 00000100:00100000:3.0:1789446294.215188:0:24332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789446294.215197:0:24332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d372ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794669824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789446294.215331:0:24332:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789446294.215335:0:24332:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1789446294.215337:0:24332:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789446294.215339:0:24332:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1789446293 -> 1789446293 00002000:00010000:3.0:1789446294.215341:0:24332:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789446294.215558:0:24332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d372ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3659:x1876369794669824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 362us (547us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1789446294.215566:0:24332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1789446294.215915:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789446294.217424:0:3659:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c2d3edcca80/2, rc 0, transno 12884901892 00000100:00100000:1.0:1789446294.217437:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794669824:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789446294.220469:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446294.220669:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773595520 00000100:00100000:3.0:1789446294.220678:0:24833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773595520 00000100:00100000:3.0:1789446294.220732:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:3.0:1789446294.220742:0:24833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+7:2407:x1876369773595520:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789446294.220841:0:24833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+7:2407:x1876369773595520:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 Request processed in 100us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446294.220848:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:3.0:1789446294.237819:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446294.237922:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773595776 00000100:00100000:1.0:1789446294.237932:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773595776 00000100:00100000:1.0:1789446294.238044:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00100000:1.0:1789446294.238054:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c081d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+15:18791:x1876369773595776:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789446294.238110:0:22826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789446294.238137:0:22826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550e11 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6552f expref: 15 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.238157:0:22826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c2d18a5c000) 00010000:00010000:1.0:1789446294.238162:0:22826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789446294.238192:0:22826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9de00/0x62554ff374550e1f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.238206:0:22826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9de00/0x62554ff374550e1f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.238229:0:22826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9de00/0x62554ff374550e1f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789446294.238360:0:22826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b1ea22e reply state 00000000c0fd6a44 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9de00/0x62554ff374550e1f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.238373:0:22826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9de00/0x62554ff374550e1f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.238379:0:22826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c2d18a5c000) 00010000:00010000:1.0:1789446294.238382:0:22826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789446294.238385:0:22826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789446294.238496:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c081d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+16:18791:x1876369773595776:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 443us (687us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1789446294.238504:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00100000:2.0:1789446294.245187:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446294.245280:0:24331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773595904 00000100:00100000:1.0:1789446294.245290:0:24331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773595904 00000100:00100000:1.0:1789446294.245345:0:24331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:1.0:1789446294.245355:0:24331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+7:18791:x1876369773595904:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789446294.245382:0:24331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446294.245401:0:24331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550e26 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a6553d expref: -99 pid: 24331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.245430:0:24331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e18 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65536 expref: 8 pid: 24833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.245448:0:24331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446294.245464:0:24331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446294.245471:0:24331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550e26 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6553d expref: 8 pid: 24331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.245506:0:24331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65536 expref: 8 pid: 24833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.245519:0:24331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65536 expref: 8 pid: 24833 timeout: 776 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446294.245533:0:24331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24331:1876369794669952:192.168.206.48@tcp:104: 00000100:00100000:1.0:1789446294.245612:0:24331:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067699c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789446294.250079:0:24331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24331:1876369794669952:192.168.206.48@tcp:104: 00010000:00010000:1.0:1789446294.250116:0:24331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550e26 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6553d expref: 8 pid: 24331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.250137:0:24331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d2fa9ca00, rc 0) 00000100:00100000:1.0:1789446294.250200:0:24331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+8:18791:x1876369773595904:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 4845us (5021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446294.250208:0:24331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:0.0:1789446294.254229:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446294.254341:0:22809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773596032 00000100:00100000:3.0:1789446294.254351:0:22809:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773596032 00010000:00010000:3.0:1789446294.254417:0:22809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65536 expref: 8 pid: 24833 timeout: 776 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446294.254468:0:22809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:3.0:1789446294.254478:0:22809:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+8:2406:x1876369773596032:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789446294.254503:0:22809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789446294.254526:0:22809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65536 expref: 8 pid: 24833 timeout: 776 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.254540:0:22809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65536 expref: 8 pid: 24833 timeout: 776 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.254564:0:22809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e18 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65536 expref: 8 pid: 24833 timeout: 776 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.254580:0:22809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789446294.254585:0:22809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789446294.254592:0:22809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550e26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6553d expref: 7 pid: 24331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.254602:0:22809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550e26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6553d expref: 7 pid: 24331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.254640:0:22809:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550e26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6553d expref: 7 pid: 24331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446294.254667:0:22809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c081d1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22809:1876369794670080:192.168.206.48@tcp:105: 00000100:00100000:3.0:1789446294.254746:0:22809:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d07f55000 going to sleep for 11 seconds 00000100:00100000:3.0:1789446294.258761:0:22809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c081d1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22809:1876369794670080:192.168.206.48@tcp:105: 00010000:00010000:3.0:1789446294.258785:0:22809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789446294.258848:0:22809:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+7:2406:x1876369773596032:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 4371us (4628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446294.258858:0:22809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:2.0:1789446294.261688:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446294.262069:0:24833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773596160 00000100:00100000:3.0:1789446294.262080:0:24833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773596160 00000100:00100000:3.0:1789446294.262185:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:3.0:1789446294.262195:0:24833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+7:2407:x1876369773596160:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789446294.262340:0:24833:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789446294.262344:0:24833:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1789446293 00002000:00010000:3.0:1789446294.262347:0:24833:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1789446292 00002000:00010000:3.0:1789446294.262349:0:24833:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1789446293 -> 1789446293 00002000:00010000:3.0:1789446294.262350:0:24833:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789446294.262420:0:24833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+8:2407:x1876369773596160:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 226us (739us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1789446294.262428:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:0.0:1789446294.271434:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789446294.271603:0:24332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773596288 00000100:00100000:3.0:1789446294.271613:0:24332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773596288 00000100:00100000:3.0:1789446294.271675:0:24332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:3.0:1789446294.271686:0:24332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+8:2406:x1876369773596288:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789446294.271745:0:24332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e2d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.271765:0:24332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550e26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6553d expref: 8 pid: 24331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.271775:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789446294.271780:0:24332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789446294.271784:0:24332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e2d lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.271817:0:24332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550e26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6553d expref: 8 pid: 24331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.271830:0:24332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550e26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6553d expref: 8 pid: 24331 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446294.271843:0:24332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c081d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24332:1876369794670208:192.168.206.48@tcp:104: 00000100:00100000:3.0:1789446294.271930:0:24332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d07f55000 going to sleep for 11 seconds 00000100:00100000:3.0:1789446294.281865:0:24332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c081d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24332:1876369794670208:192.168.206.48@tcp:104: 00010000:00010000:3.0:1789446294.281894:0:24332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e2d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446294.282655:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446294.283761:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773596416 00000100:00100000:2.0:1789446294.283772:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773596416 00010000:00010000:2.0:1789446294.283816:0:22811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550e26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6553d expref: 9 pid: 24331 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446294.283863:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:2.0:1789446294.283873:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+9:2406:x1876369773596416:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789446294.283888:0:22811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789446294.283910:0:22811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550e26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6553d expref: 9 pid: 24331 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.283924:0:22811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550e26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6553d expref: 9 pid: 24331 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.284002:0:22811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550e26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6553d expref: 9 pid: 24331 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.284030:0:22811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789446294.284049:0:22811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789446294.284055:0:22811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e2d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.284066:0:22811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e2d lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.284325:0:22811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789446294.284402:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+8:2406:x1876369773596416:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 529us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446294.284411:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 20 00010000:00010000:3.0:1789446294.292640:0:24332:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e2d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.292678:0:24332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e2d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.292712:0:24332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e2d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.292721:0:24332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e2d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.292728:0:24332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e2d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.292735:0:24332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d39b60000 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:3.0:1789446294.292740:0:24332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e2d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.292749:0:24332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e2d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.292768:0:24332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e2d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789446294.292776:0:24332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b437eb7f/0x62554ff374550e2d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789446294.292935:0:24332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+7:2406:x1876369773596288:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 Request processed in 21246us (21507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446294.292946:0:24332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:0.0:1789446294.306436:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446294.306527:0:22824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773596672 00000100:00100000:1.0:1789446294.306537:0:22824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773596672 00000100:00100000:1.0:1789446294.306592:0:22824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:1.0:1789446294.306602:0:22824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+16:18791:x1876369773596672:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789446294.306674:0:22824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550e34 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.306703:0:22824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550d7e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654fe expref: 16 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.306712:0:22824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550e34 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.306744:0:22824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550d7e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654fe expref: 16 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.306757:0:22824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550d7e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654fe expref: 16 pid: 22825 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446294.306770:0:22824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22824:1876369794670336:192.168.206.48@tcp:104: 00000100:00100000:1.0:1789446294.306849:0:22824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c067699c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789446294.323252:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446294.323412:0:22824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22824:1876369794670336:192.168.206.48@tcp:104: 00010000:00010000:1.0:1789446294.323439:0:22824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550e34 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446294.323630:0:23578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773596800 00000100:00100000:0.0:1789446294.323638:0:23578:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773596800 00010000:00010000:0.0:1789446294.323673:0:23578:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550d7e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654fe expref: 17 pid: 22825 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446294.323713:0:23578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:0.0:1789446294.323723:0:23578:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+17:2406:x1876369773596800:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789446294.323737:0:23578:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789446294.323744:0:23578:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550d7e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654fe expref: 17 pid: 22825 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.323757:0:23578:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550d7e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654fe expref: 17 pid: 22825 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.323779:0:23578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00030000/0x62554ff374550d7e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a654fe expref: 17 pid: 22825 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.323797:0:23578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:0.0:1789446294.323803:0:23578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807e00/0x62554ff374550d9a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6550c expref: 16 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.323812:0:23578:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550e34 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.323838:0:23578:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550e34 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.323845:0:23578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550e34 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.323873:0:23578:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789446294.324218:0:23578:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a97a55b2-7974-4297-b5cb-8884d980fe73+16:2406:x1876369773596800:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 495us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446294.324227:0:23578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 21 00010000:00010000:1.0:1789446294.324353:0:22824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550e34 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.324361:0:22824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550e34 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.324557:0:22824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550e3b lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.324570:0:22824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51800/0x62554ff374550e03 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65528 expref: 16 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.324585:0:22824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550e3b lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.324614:0:22824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51800/0x62554ff374550e03 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65528 expref: 16 pid: 25435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.324628:0:22824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51800/0x62554ff374550e03 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65528 expref: 16 pid: 25435 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446294.324641:0:22824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22824:1876369794670464:192.168.206.48@tcp:104: 00000100:00100000:1.0:1789446294.324693:0:22824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2c06769000 going to sleep for 11 seconds 00000100:00100000:2.0:1789446294.338528:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446294.339005:0:22811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773596928 00000100:00100000:0.0:1789446294.339015:0:22811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773596928 00010000:00010000:0.0:1789446294.339063:0:22811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51800/0x62554ff374550e03 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65528 expref: 17 pid: 25435 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789446294.339098:0:22811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:0.0:1789446294.339107:0:22811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+17:2406:x1876369773596928:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789446294.339120:0:22811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789446294.339126:0:22811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51800/0x62554ff374550e03 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65528 expref: 17 pid: 25435 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.339138:0:22811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51800/0x62554ff374550e03 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65528 expref: 17 pid: 25435 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.339159:0:22811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c2d18a5c000) 00010000:00010000:0.0:1789446294.339165:0:22811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550e3b lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.339191:0:22811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550e3b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.339199:0:22811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550e3b lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.339218:0:22811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789446294.339305:0:22811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+17:2406:x1876369773596928:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 199us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446294.339312:0:22811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 22 00010000:00010000:1.0:1789446294.346208:0:22824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a51800/0x62554ff374550e03 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65528 expref: 16 pid: 25435 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446294.346246:0:22824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22824:1876369794670464:192.168.206.48@tcp:104: 00010000:00010000:1.0:1789446294.346272:0:22824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550e3b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.346304:0:22824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550e3b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.346311:0:22824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550e3b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789446294.346546:0:22824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:1.0:1789446294.346660:0:22824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:1.0:1789446294.346697:0:22824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:1.0:1789446294.346807:0:22824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22824:1876369794670592:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789446294.346865:0:22824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446294.347537:0:22824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d35d85300 going to sleep for 11 seconds 00000100:00100000:0.0:1789446294.348137:0:23565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794670592 00000100:00100000:0.0:1789446294.348147:0:23565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794670592 00000100:00100000:0.0:1789446294.348215:0:23565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789446294.348236:0:23565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22824:x1876369794670592:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789446294.348612:0:23565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22824:x1876369794670592:12345-0@lo:1000:mdt00_000.0 Request processed in 377us (1745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446294.348620:0:23565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789446294.348683:0:22824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22824:1876369794670592:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789446294.348843:0:22824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1789446294.348906:0:22824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22824:1876369794670720:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789446294.348941:0:22824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446294.349113:0:22824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d35d85540 going to sleep for 11 seconds 00000100:00100000:2.0:1789446294.352137:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794670720 00000100:00100000:2.0:1789446294.352151:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794670720 00000100:00100000:2.0:1789446294.352266:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789446294.352278:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22824:x1876369794670720:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789446294.352497:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22824:x1876369794670720:12345-0@lo:1000:mdt00_000.0 Request processed in 221us (3554us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1789446294.352505:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789446294.352582:0:22824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22824:1876369794670720:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789446294.352628:0:22824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550e3b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.352639:0:22824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550e3b lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.352647:0:22824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550e3b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.352653:0:22824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9ca00 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:1.0:1789446294.352657:0:22824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550e3b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.352665:0:22824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550e3b lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.352679:0:22824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c2d18a5c000) 00010000:00010000:1.0:1789446294.352682:0:22824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789446294.352687:0:22824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550e3b lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.352710:0:22824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9ca00/0x62554ff374550e3b lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.352742:0:22824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00031200/0x62554ff374550d93 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.352749:0:22824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00031200/0x62554ff374550d93 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.352754:0:22824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00031200/0x62554ff374550d93 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.352759:0:22824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d00031200 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:1.0:1789446294.352762:0:22824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00031200/0x62554ff374550d93 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.352768:0:22824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00031200/0x62554ff374550d93 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.352776:0:22824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:1.0:1789446294.352778:0:22824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789446294.352784:0:22824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807e00/0x62554ff374550d9a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6550c expref: 19 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.352796:0:22824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807e00/0x62554ff374550d9a lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6550c expref: 19 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.352804:0:22824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807e00/0x62554ff374550d9a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6550c expref: 19 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.352884:0:22824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36807e00/0x62554ff374550d9a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a6550c expref: 19 pid: 22825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789446294.352898:0:22824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22824:1876369794670848:192.168.206.48@tcp:105: 00000100:00100000:1.0:1789446294.353003:0:22824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c2d35d85cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789446294.359841:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446294.359939:0:22824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22824:1876369794670848:192.168.206.48@tcp:105: 00000100:00100000:3.0:1789446294.360050:0:22827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773597056 00000100:00100000:3.0:1789446294.360057:0:22827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773597056 00000100:00100000:3.0:1789446294.360107:0:22827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:3.0:1789446294.360116:0:22827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c07b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+20:18789:x1876369773597056:12345-192.168.206.48@tcp:49:dd.0 00000100:00100000:3.0:1789446294.360228:0:22827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c07b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+20:18789:x1876369773597056:12345-192.168.206.48@tcp:49:dd.0 Request processed in 112us (396us total) trans 0 rc 0/0 00010000:00010000:2.0:1789446294.360338:0:22824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00031200/0x62554ff374550d93 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.360349:0:22824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d00031200/0x62554ff374550d93 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 25435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.360501:0:22824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6600/0x62554ff374550e42 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.360529:0:22824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6600/0x62554ff374550e42 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.360540:0:22824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6600/0x62554ff374550e42 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.360551:0:22824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6600/0x62554ff374550e42 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.360558:0:22824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6600/0x62554ff374550e42 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.360564:0:22824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6600/0x62554ff374550e42 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.360571:0:22824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d13ba6600 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:2.0:1789446294.360575:0:22824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6600/0x62554ff374550e42 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.360582:0:22824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6600/0x62554ff374550e42 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.360592:0:22824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:2.0:1789446294.360595:0:22824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789446294.360598:0:22824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6600/0x62554ff374550e42 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.360604:0:22824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d13ba6600/0x62554ff374550e42 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.360615:0:22824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550e34 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.360627:0:22824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550e34 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.360633:0:22824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550e34 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.360638:0:22824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9cc00 already unused, calling callback (ffffffffc1aef4f0) 00010000:00010000:2.0:1789446294.360642:0:22824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550e34 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.360648:0:22824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550e34 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.360655:0:22824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:2.0:1789446294.360657:0:22824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789446294.360660:0:22824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550e34 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.360666:0:22824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9cc00/0x62554ff374550e34 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446294.360796:0:22824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a97a55b2-7974-4297-b5cb-8884d980fe73+20:18791:x1876369773596672:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 54193us (54368us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1789446294.360804:0:22824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 63 00000020:00080000:2.0:1789446294.360809:0:22824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789446294.360863:0:22827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000040:00080000:0.0:1789446294.361225:0:22862:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789446294.361298:0:22862:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789446294.361318:0:22862:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1789446294.361324:0:22862:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1789446294.365038:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789446294.365134:0:22826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773597184 00000100:00100000:1.0:1789446294.365143:0:22826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773597184 00000100:00100000:1.0:1789446294.365192:0:22826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:1.0:1789446294.365201:0:22826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+19:18789:x1876369773597184:12345-192.168.206.48@tcp:101:dd.0 00010000:00010000:1.0:1789446294.365220:0:22826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789446294.365249:0:22826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550e49 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb5e9f06216a65544 expref: -99 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.365279:0:22826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550e50 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.365291:0:22826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550e50 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.365302:0:22826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550e50 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.365415:0:22826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d600/0x62554ff374550e49 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65544 expref: 21 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.365432:0:22826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d2fa9d200/0x62554ff374550e50 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0xb5e9f06216a65544 expref: 20 pid: 22826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.365452:0:22826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c2d02f24800) 00010000:00010000:1.0:1789446294.365455:0:22826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789446294.365458:0:22826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2d2fa9d200, rc 0) 00000100:00100000:1.0:1789446294.365501:0:22826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a97a55b2-7974-4297-b5cb-8884d980fe73+20:18789:x1876369773597184:12345-192.168.206.48@tcp:101:dd.0 Request processed in 302us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446294.365507:0:22826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:2.0:1789446294.376439:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446294.376532:0:22828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773597440 00000100:00100000:0.0:1789446294.376543:0:22828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773597440 00000100:00100000:0.0:1789446294.376600:0:22828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:0.0:1789446294.376610:0:22828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+20:18791:x1876369773597440:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789446294.376875:0:22828:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789446294.376906:0:22828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:0.0:1789446294.377126:0:22828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550e57 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.377145:0:22828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550e57 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.377157:0:22828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550e57 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.377167:0:22828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550e57 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.377174:0:22828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550e57 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.377179:0:22828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550e57 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789446294.377201:0:22828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789446294.377295:0:22828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+22:18791:x1876369773597440:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 684us (862us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1789446294.377303:0:22828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000020:00080000:0.0:1789446294.377308:0:22828:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789446294.377714:0:22813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789446294.377722:0:22813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550e57 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.377743:0:22813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d36a50c00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:2.0:1789446294.377747:0:22813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550e57 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.377756:0:22813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550e57 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.377769:0:22813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c2d18a5c000) 00010000:00010000:2.0:1789446294.377772:0:22813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789446294.377777:0:22813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550e57 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.377783:0:22813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2d36a50c00/0x62554ff374550e57 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.377796:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446294.377798:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789446294.377800:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789446294.405823:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789446294.405931:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789446294.406343:0:24335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773597696 00000100:00100000:2.0:1789446294.406355:0:24335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773597696 00000100:00100000:1.0:1789446294.406530:0:24336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369773597568 00000100:00100000:1.0:1789446294.406536:0:24336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369773597568 00000100:00100000:1.0:1789446294.406577:0:24336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:1.0:1789446294.406587:0:24336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+8:2405:x1876369773597696:12345-192.168.206.48@tcp:4:dd.0 00002000:00010000:1.0:1789446294.406633:0:24336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6aa8c895, atime: 0x6aa8c894, ctime: 0x6aa8c895, blocks: 0x0 00010000:00010000:1.0:1789446294.406642:0:24336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550e5e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.406658:0:24336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1789446294.406662:0:24336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789446294.406669:0:24336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550e5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789446294.406683:0:24336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550e5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789446294.503622:0:25146:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:3.0:1789446294.503640:0:25146:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:2.0:1789446294.506698:0:24336:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:2.0:1789446294.506707:0:24336:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:2.0:1789446294.506726:0:24336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550e5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.506740:0:24336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550e5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.506750:0:24336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550e5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.506775:0:24336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d2fa9ca00 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:2.0:1789446294.506780:0:24336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550e5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.506789:0:24336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550e5e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.506809:0:24336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550e5e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.506818:0:24336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000214f7b95/0x62554ff374550e5e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446294.507055:0:24336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+6:2405:x1876369773597696:12345-192.168.206.48@tcp:4:dd.0 Request processed in 100463us (101237us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1789446294.507065:0:24336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:2.0:1789446294.507097:0:24336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:2.0:1789446294.507109:0:24336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+5:2405:x1876369773597568:12345-192.168.206.48@tcp:4:dd.0 00002000:00010000:2.0:1789446294.507146:0:24336:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 7654321, mtime: 0x6aa8c895, atime: 0x6aa8c894, ctime: 0x6aa8c895, blocks: 0x1a68 00010000:00010000:2.0:1789446294.507153:0:24336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7292305/0x62554ff374550e65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.507164:0:24336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1789446294.507169:0:24336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789446294.507182:0:24336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7292305/0x62554ff374550e65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.507194:0:24336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7292305/0x62554ff374550e65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789446294.611713:0:25146:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:2.0:1789446294.612009:0:24336:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:2.0:1789446294.612043:0:24336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7292305/0x62554ff374550e65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.612058:0:24336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7292305/0x62554ff374550e65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.612068:0:24336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7292305/0x62554ff374550e65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.612076:0:24336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2d13ba6600 already unused, calling callback (ffffffffc0ede8b0) 00010000:00010000:2.0:1789446294.612081:0:24336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7292305/0x62554ff374550e65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.612090:0:24336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7292305/0x62554ff374550e65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.612109:0:24336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7292305/0x62554ff374550e65 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789446294.612116:0:24336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7292305/0x62554ff374550e65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789446294.612227:0:24336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a97a55b2-7974-4297-b5cb-8884d980fe73+5:2405:x1876369773597568:12345-192.168.206.48@tcp:4:dd.0 Request processed in 105116us (206290us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1789446294.617289:0:24336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 1 00010000:00010000:0.0:1789446294.694238:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789446294.758396:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789446294.758419:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c081d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794670976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789446294.758483:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446294.758822:0:23565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794670976 00000100:00100000:2.0:1789446294.758831:0:23565:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794670976 00000100:00100000:2.0:1789446294.758888:0:23565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789446294.758897:0:23565:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794670976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789446294.758929:0:23565:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789446294.759112:0:23565:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794670976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 215us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446294.759121:0:23565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789446294.759488:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794671104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789446294.759524:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446294.759608:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794671104 00000100:00100000:0.0:1789446294.759613:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794671104 00000100:00100000:0.0:1789446294.759641:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789446294.759648:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794671104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789446294.759668:0:22830:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1789446294.759711:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794671104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446294.759718:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789446294.759754:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794671104:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789446294.759916:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c081d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794670976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789446294.760485:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789446294.760496:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c081d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794671232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789446294.760533:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789446294.760628:0:24333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794671232 00000100:00100000:3.0:1789446294.760633:0:24333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794671232 00000100:00100000:3.0:1789446294.760689:0:24333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789446294.760698:0:24333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39bb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794671232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789446294.760719:0:24333:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789446294.760757:0:24333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39bb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794671232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789446294.760764:0:24333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789446294.760896:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789446294.760924:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c081d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794671232:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789446295.718814:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789446295.785493:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789446295.785524:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1876369794671360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789446295.785590:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446295.785927:0:24333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794671360 00000100:00100000:1.0:1789446295.785936:0:24333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794671360 00000100:00100000:1.0:1789446295.786035:0:24333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789446295.786116:0:24333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c081d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876369794671360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789446295.786137:0:24333:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1789446295.786274:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789446295.786311:0:24333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c081d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1876369794671360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446295.786320:0:24333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789446295.786371:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1876369794671360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789446296.295073:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d3edcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1876369794671488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789446296.295135:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446296.295186:0:24333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794671488 00000100:00100000:1.0:1789446296.295193:0:24333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794671488 00000100:00100000:1.0:1789446296.295244:0:24333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789446296.295252:0:24333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876369794671488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789446296.295279:0:24333:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3908202496 avail 3676680192 00000100:00100000:1.0:1789446296.295319:0:24333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1876369794671488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446296.295325:0:24333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1789446296.295355:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789446296.295392:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d3edcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1876369794671488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789446296.295743:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d39bb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:282408b2-7484-4ad3-93ba-27093493daa8:3657:1876369794671616:0@lo:400:kworker.0 00000100:00100000:0.0:1789446296.295776:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446296.295840:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c055d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1876369794672128:0@lo:400:kworker.0 00000100:00100000:0.0:1789446296.295865:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446296.295888:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c055d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1876369794672640:0@lo:400:kworker.0 00000100:00100000:0.0:1789446296.295919:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446296.295941:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789446296.295947:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d39bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1876369794671744:0@lo:400:kworker.0 00000100:00100000:0.0:1789446296.295985:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446296.296007:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c055d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794672256:0@lo:400:kworker.0 00000100:00100000:0.0:1789446296.296039:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446296.296072:0:3657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c055d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1876369794672768:0@lo:400:kworker.0 00000100:00100000:0.0:1789446296.296093:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789446296.296123:0:22818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794671616 00000100:00100000:0.0:1789446296.296128:0:22818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794671616 00000100:00100000:0.0:1789446296.296155:0:22818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789446296.296162:0:22818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3151f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+24:3657:x1876369794671616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446296.296205:0:22818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3151f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:282408b2-7484-4ad3-93ba-27093493daa8+24:3657:x1876369794671616:12345-0@lo:400:kworker.0 Request processed in 43us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446296.296212:0:22818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789446296.296238:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794672128 00000100:00100000:0.0:1789446296.296241:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794672128 00000100:00100000:0.0:1789446296.296261:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794672640 00000100:00100000:0.0:1789446296.296264:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794672640 00000100:00100000:0.0:1789446296.296279:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794672768 00000100:00100000:0.0:1789446296.296282:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794672768 00000100:00100000:0.0:1789446296.296295:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789446296.296300:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c055d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1876369794672128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446296.296336:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c055d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1876369794672128:12345-0@lo:400:kworker.0 Request processed in 35us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446296.296342:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789446296.296369:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789446296.296375:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c055d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1876369794672640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446296.296408:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c055d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1876369794672640:12345-0@lo:400:kworker.0 Request processed in 33us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446296.296414:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789446296.296426:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789446296.296431:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c055d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1876369794672768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446296.296474:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c055d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1876369794672768:12345-0@lo:400:kworker.0 Request processed in 43us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446296.296480:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789446296.296500:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794671744 00000100:00100000:0.0:1789446296.296503:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794671744 00000100:00100000:0.0:1789446296.296523:0:22830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794672256 00000100:00100000:0.0:1789446296.296526:0:22830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794672256 00000100:00100000:0.0:1789446296.296539:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789446296.296545:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c055d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1876369794671744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446296.296580:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c055d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1876369794671744:12345-0@lo:400:kworker.0 Request processed in 35us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446296.296586:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789446296.296598:0:22830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789446296.296603:0:22830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2c055d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794672256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446296.296636:0:22830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2c055d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3657:x1876369794672256:12345-0@lo:400:kworker.0 Request processed in 33us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446296.296642:0:22830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789446296.296673:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d39bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1876369794671744:0@lo:400:kworker.0 00000100:00100000:0.0:1789446296.296683:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c055d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1876369794672256:0@lo:400:kworker.0 00010000:00080000:0.0:1789446296.296694:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2c055d1500 x1876369794672768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789446296.296703:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c055d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1876369794672768:0@lo:400:kworker.0 00000100:00100000:0.0:1789446296.296711:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d39bb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:282408b2-7484-4ad3-93ba-27093493daa8:3657:1876369794671616:0@lo:400:kworker.0 00000100:00100000:0.0:1789446296.296719:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c055d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1876369794672128:0@lo:400:kworker.0 00000100:00100000:0.0:1789446296.296738:0:3657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c055d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1876369794672640:0@lo:400:kworker.0 00000100:00100000:1.0:1789446296.297256:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d39bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794671872:0@lo:400:kworker.0 00000100:00100000:1.0:1789446296.297299:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446296.297326:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c055d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794672384:0@lo:400:kworker.0 00000100:00100000:2.0:1789446296.297335:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789446296.297347:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d39b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1876369794673152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789446296.297383:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446296.297389:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446296.297409:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c055d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1876369794672896:0@lo:400:kworker.0 00000100:00100000:1.0:1789446296.297435:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789446296.297463:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794672896 00000100:00100000:1.0:1789446296.297463:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789446296.297470:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794672896 00000100:00100000:1.0:1789446296.297471:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2d39bb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794672000:0@lo:400:kworker.0 00000100:00100000:1.0:1789446296.297496:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446296.297516:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c055d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876369794672512:0@lo:400:kworker.0 00000100:00100000:2.0:1789446296.297520:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789446296.297532:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876369794672896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446296.297544:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446296.297566:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c2c055d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1876369794673024:0@lo:400:kworker.0 00000100:00100000:2.0:1789446296.298113:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1876369794672896:12345-0@lo:400:kworker.0 Request processed in 581us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446296.298122:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789446296.298140:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794672512 00000100:00100000:2.0:1789446296.298145:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794672512 00000100:00100000:2.0:1789446296.298170:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789446296.298177:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ff44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876369794672512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789446296.301411:0:24331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794671872 00000100:00100000:1.0:1789446296.301424:0:24331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794671872 00000100:00100000:1.0:1789446296.301472:0:24331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794672384 00000100:00100000:1.0:1789446296.301475:0:24331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794672384 00000100:00100000:1.0:1789446296.301493:0:24331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794672000 00000100:00100000:1.0:1789446296.301495:0:24331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794672000 00000100:00100000:1.0:1789446296.301517:0:24331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789446296.301526:0:24331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794671872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789446296.301533:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ff44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1876369794672512:12345-0@lo:400:kworker.0 Request processed in 3352us (3985us total) trans 0 rc 0/0 00000100:00100000:2.0:1789446296.301546:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789446296.301586:0:24331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794671872:12345-0@lo:400:kworker.0 Request processed in 60us (4286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446296.301593:0:24331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789446296.301692:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789446296.301702:0:24833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794672384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446296.301776:0:24833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1876369794672384:12345-0@lo:400:kworker.0 Request processed in 76us (4393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446296.301782:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789446296.301795:0:24833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789446296.301801:0:24833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3edcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794672000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789446296.301835:0:24833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3edcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1876369794672000:12345-0@lo:400:kworker.0 Request processed in 34us (4338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789446296.301841:0:24833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1789446296.301862:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789446296.301866:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789446296.301869:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789446296.301871:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789446296.302116:0:24333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794673152 00000100:00100000:1.0:1789446296.302122:0:24333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794673152 00000100:00100000:1.0:1789446296.302155:0:24333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789446296.302161:0:24333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d39b27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1876369794673152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789446296.302176:0:24333:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3908202496 avail 3676680192 00000100:00100000:1.0:1789446296.302221:0:24333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d39b27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1876369794673152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (4833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446296.302237:0:24333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789446296.302267:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789446296.302294:0:25435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876369794673024 00000100:00100000:1.0:1789446296.302298:0:25435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876369794673024 00000100:00100000:1.0:1789446296.302327:0:25435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789446296.302333:0:25435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2d3ff46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876369794673024:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789446296.302418:0:22820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789446296.302467:0:25435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2d3ff46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1876369794673024:12345-0@lo:400:kworker.0 Request processed in 133us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789446296.302474:0:25435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1789446296.302510:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2c055d3480 x1876369794673024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789446312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789446296.302524:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c055d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1876369794673024:0@lo:400:kworker.0 00000100:00100000:1.0:1789446296.302537:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d39bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794671872:0@lo:400:kworker.0 00000100:00100000:1.0:1789446296.302548:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c055d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1876369794672384:0@lo:400:kworker.0 00000100:00100000:1.0:1789446296.302559:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c055d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1876369794672896:0@lo:400:kworker.0 00000100:00100000:1.0:1789446296.302585:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:1.0:1789446296.302589:0:3659:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c2d3edcca80, transno 12884901892 00000004:00080000:1.0:1789446296.302749:0:3659:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:1.0:1789446296.302768:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d39bb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1876369794672000:0@lo:400:kworker.0 00000100:00100000:2.0:1789446296.306110:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2d39b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1876369794673152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789446296.313524:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c2c055d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1876369794672512:0@lo:400:kworker.0 00000040:00080000:1.0:1789446296.427283:0:22862:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789446296.427291:0:22862:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789446296.427310:0:22862:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1789446296.427329:0:22862:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000001:02000400:0.0:1789446296.551242:0:25907:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1789446296.743461:0:22812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789446297.767445:0:22813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 13898 lines, 13898 kept, 0 dropped, 0 bad.