00000001:00080000:0.0F:1788305810.927685:0:17132:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:0.0:1788305810.927728:0:17132:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88918453b300 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:0.0:1788305810.927734:0:17132:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889186262d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8891bb2d9c00 00000020:00080000:0.0:1788305810.927737:0:17132:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889186262000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8891bbbfb200 00000020:00080000:2.0F:1788305810.927805:0:17190:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00010000:00010000:1.0F:1788305810.927838:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e6054e50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305810.927859:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e6054e50 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305810.927867:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e6054e50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305810.927873:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181682a00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305810.927878:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e6054e50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305810.927894:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e6054e50 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305810.927916:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8890825b9500) 00010000:00010000:1.0:1788305810.927920:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305810.927926:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e6054e50 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305810.927932:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e6054e50 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788305810.927945:0:17190:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788305810.967102:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305811.998613:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1788305812.615543:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305812.615612:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305812.615641:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305812.615674:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305812.615701:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305812.615743:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305812.615772:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994283392 00000100:00100000:3.0:1788305812.615781:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994283392 00000100:00100000:3.0:1788305812.615828:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994283520 00000100:00100000:3.0:1788305812.615831:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994283520 00000100:00100000:3.0:1788305812.616023:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994283776 00000100:00100000:3.0:1788305812.616026:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994283776 00000100:00100000:3.0:1788305812.616041:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994283904 00000100:00100000:3.0:1788305812.616043:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994283904 00000100:00100000:3.0:1788305812.616058:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 91 00000100:00100000:3.0:1788305812.616066:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+12:2396:x1875173994283392:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305812.616135:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+12:2396:x1875173994283392:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 69us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305812.616142:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 91 00000100:00100000:3.0:1788305812.616156:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 92 00000100:00100000:3.0:1788305812.616163:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2395:x1875173994283520:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305812.616187:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2395:x1875173994283520:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 24us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305812.616193:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 92 00000100:00100000:3.0:1788305812.616205:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 93 00000100:00100000:3.0:1788305812.616211:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2395:x1875173994283776:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305812.616234:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2395:x1875173994283776:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 23us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305812.616260:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 93 00000100:00100000:3.0:1788305812.616273:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 94 00000100:00100000:3.0:1788305812.616307:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2396:x1875173994283904:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305812.616331:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2396:x1875173994283904:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 25us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305812.616338:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 94 00000100:00100000:3.0:1788305812.616356:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994283648 00000100:00100000:3.0:1788305812.616360:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994283648 00000100:00100000:3.0:1788305812.616386:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 34 00000100:00100000:3.0:1788305812.616392:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2396:x1875173994283648:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305812.616415:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2396:x1875173994283648:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 24us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305812.616421:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 34 00000100:00080000:3.0:1788305812.616438:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305812.616442:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788305812.616445:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305812.617105:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994283264 00000100:00100000:2.0:1788305812.617113:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994283264 00000100:00100000:2.0:1788305812.617170:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 173 00000100:00100000:2.0:1788305812.617178:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:2395:x1875173994283264:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305812.617215:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:2395:x1875173994283264:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 39us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305812.617222:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 173 00000040:00080000:0.0:1788305812.885472:0:17185:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788305812.885482:0:17185:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788305812.885501:0:17185:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788305812.885508:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788305813.016078:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305814.071264:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305814.488967:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015330944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305814.489034:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305814.489105:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015330944 00000100:00100000:3.0:1788305814.489112:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015330944 00000100:00100000:3.0:1788305814.489164:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788305814.489173:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015330944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788305814.489201:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788305814.489257:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015330944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305814.489300:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788305814.489320:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305814.489353:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015330944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788305814.639697:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305814.639740:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305814.639762:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305814.639781:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305814.639803:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305814.639827:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305814.639855:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994284288 00000100:00100000:1.0:1788305814.639879:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994284288 00000100:00100000:1.0:1788305814.639931:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994284544 00000100:00100000:1.0:1788305814.639935:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994284544 00000100:00100000:1.0:1788305814.639947:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994284160 00000100:00100000:1.0:1788305814.639949:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994284160 00000100:00100000:1.0:1788305814.639961:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994284672 00000100:00100000:1.0:1788305814.639963:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994284672 00000100:00100000:1.0:1788305814.639977:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 95 00000100:00100000:1.0:1788305814.639986:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2395:x1875173994284288:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305814.640057:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2395:x1875173994284288:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 72us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305814.640064:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 95 00000100:00100000:1.0:1788305814.640081:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 96 00000100:00100000:1.0:1788305814.640089:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2395:x1875173994284544:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305814.640115:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2395:x1875173994284544:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 28us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305814.640121:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 96 00000100:00100000:1.0:1788305814.640132:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 97 00000100:00100000:1.0:1788305814.640138:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+12:2395:x1875173994284160:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305814.640162:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+12:2395:x1875173994284160:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 24us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305814.640168:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 97 00000100:00100000:1.0:1788305814.640179:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 98 00000100:00100000:1.0:1788305814.640185:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2395:x1875173994284672:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305814.640207:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2395:x1875173994284672:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 22us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305814.640223:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 98 00000100:00100000:1.0:1788305814.640261:0:20293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994284416 00000100:00100000:1.0:1788305814.640265:0:20293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994284416 00000100:00100000:1.0:1788305814.640326:0:20293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 35 00000100:00100000:1.0:1788305814.640333:0:20293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2395:x1875173994284416:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305814.640359:0:20293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2395:x1875173994284416:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 27us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305814.640366:0:20293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 35 00000100:00080000:1.0:1788305814.640385:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788305814.640389:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788305814.640391:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788305814.640668:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994284032 00000100:00100000:3.0:1788305814.640674:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994284032 00000100:00100000:3.0:1788305814.640710:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 174 00000100:00100000:3.0:1788305814.640717:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:2395:x1875173994284032:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305814.640750:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:2395:x1875173994284032:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 34us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305814.640756:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 174 00000001:00100000:0.0:1788305815.013955:0:18655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 41b2c320-efb9-4bcd-bd61-e9037c280b63 00000020:00000080:0.0:1788305815.013969:0:18655:0:(genops.c:885:class_export_put()) final put ffff8891bd759800/41b2c320-efb9-4bcd-bd61-e9037c280b63 00000001:00100000:0.0:1788305815.014014:0:18655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0f32c93b-849d-4ca6-ae0d-05edb696d5c1 00000020:00000080:0.0:1788305815.014017:0:18655:0:(genops.c:885:class_export_put()) final put ffff8891b998a000/0f32c93b-849d-4ca6-ae0d-05edb696d5c1 00000020:00000080:0.0:1788305815.014038:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bd759800/41b2c320-efb9-4bcd-bd61-e9037c280b63 for lustre-OST0000 00000020:00000080:0.0:1788305815.014097:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8891b998a000/0f32c93b-849d-4ca6-ae0d-05edb696d5c1 for lustre-OST0000 00000020:00000080:0.0:1788305815.014117:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891bd75f000 for lustre-OST0000 00000020:00000080:0.0:1788305815.014123:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891b998d000 for lustre-OST0000 00000001:00100000:0.0:1788305815.025167:0:19473:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 41b2c320-efb9-4bcd-bd61-e9037c280b63 00000020:00000080:0.0:1788305815.025181:0:19473:0:(genops.c:885:class_export_put()) final put ffff8891bd75b800/41b2c320-efb9-4bcd-bd61-e9037c280b63 00000020:00000080:0.0:1788305815.025219:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bd75b800/41b2c320-efb9-4bcd-bd61-e9037c280b63 for lustre-OST0001 00000020:00000080:0.0:1788305815.025322:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891bd75c800 for lustre-OST0001 00010000:00010000:2.0:1788305815.128447:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305815.363385:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305815.363436:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994284800 00000100:00100000:2.0:1788305815.363447:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994284800 00000100:00100000:2.0:1788305815.363513:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 74 00000100:00100000:2.0:1788305815.363524:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+12:15586:x1875173994284800:12345-192.168.202.55@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788305815.363660:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+12:15586:x1875173994284800:12345-192.168.202.55@tcp:60:lhsmtool_posix.0 Request processed in 137us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305815.363669:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 74 00000100:00100000:1.0:1788305815.401481:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305815.401710:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994284928 00000100:00100000:2.0:1788305815.401724:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994284928 00000100:00100000:2.0:1788305815.401805:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 75 00000100:00100000:2.0:1788305815.401818:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:15586:x1875173994284928:12345-192.168.202.55@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788305815.401966:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:15586:x1875173994284928:12345-192.168.202.55@tcp:60:lhsmtool_posix.0 Request processed in 150us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305815.401975:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 75 00000100:00100000:2.0:1788305815.464812:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305815.464948:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994285184 00000100:00100000:0.0:1788305815.464962:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994285184 00000100:00100000:0.0:1788305815.465041:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:0.0:1788305815.465053:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826ba850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+12:15586:x1875173994285184:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788305815.465416:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826ba850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+13:15586:x1875173994285184:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 364us (812us total) trans 8589934636 rc 0/0 00000100:00100000:0.0:1788305815.465446:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:0.0:1788305815.509850:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015331072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788305815.509953:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305815.510065:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015331072 00000100:00100000:0.0:1788305815.510076:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015331072 00000100:00100000:3.0:1788305815.510085:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015331328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305815.510143:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788305815.510155:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015331072:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305815.510163:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305815.510191:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788305815.510198:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015331200:0@lo:13:osp-pre-1-1.0 00000004:00000024:0.0:1788305815.510206:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788305815.510263:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305815.510298:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015331072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305815.510308:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788305815.510330:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015331328 00000100:00100000:0.0:1788305815.510335:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015331328 00000100:00100000:3.0:1788305815.510346:0:20294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015331200 00000100:00100000:3.0:1788305815.510352:0:20294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015331200 00000100:00100000:0.0:1788305815.510379:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788305815.510389:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015331328:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305815.510403:0:20294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000004:00000024:0.0:1788305815.510410:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788305815.510416:0:20294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015331200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788305815.510442:0:20294:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788305815.510458:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015331328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305815.510465:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788305815.510481:0:20294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015331200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305815.510489:0:20294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788305815.510511:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788305815.510527:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015331456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305815.510561:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305815.510592:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015331456 00000100:00100000:3.0:1788305815.510595:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015331456 00000100:00100000:3.0:1788305815.510620:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788305815.510626:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015331456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305815.510636:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788305815.510664:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015331456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305815.510670:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788305815.510687:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788305815.510718:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015331200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788305815.510880:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015331584:0@lo:400:kworker.0 00000100:00100000:3.0:1788305815.511121:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015331456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305815.511230:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015331968:0@lo:400:kworker.0 00000100:00100000:0.0:1788305815.511439:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015331328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305815.511459:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015331840:0@lo:400:kworker.0 00000100:00100000:0.0:1788305815.511499:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305815.511521:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015332352:0@lo:400:kworker.0 00000100:00100000:0.0:1788305815.511553:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305815.511587:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788305815.511594:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015331712:0@lo:400:kworker.0 00000100:00100000:0.0:1788305815.511644:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305815.511663:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015332224:0@lo:400:kworker.0 00000100:00100000:0.0:1788305815.511686:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305815.511705:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015332736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305815.511726:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305815.511754:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015331840 00000100:00100000:0.0:1788305815.511760:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015331840 00000100:00100000:0.0:1788305815.511798:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015332352 00000100:00100000:0.0:1788305815.511800:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015332352 00000100:00100000:0.0:1788305815.511832:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015332224 00000100:00100000:0.0:1788305815.511835:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015332224 00000100:00100000:0.0:1788305815.511853:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788305815.511861:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015331840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305815.511906:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015331840:12345-0@lo:400:kworker.0 Request processed in 46us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305815.511913:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788305815.511927:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788305815.511933:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015332352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305815.511960:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015332352:12345-0@lo:400:kworker.0 Request processed in 28us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305815.511966:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788305815.511977:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788305815.511983:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015332224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305815.512019:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015332224:12345-0@lo:400:kworker.0 Request processed in 36us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305815.512026:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788305815.512066:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015332224:0@lo:400:kworker.0 00000100:00100000:0.0:1788305815.512076:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015331840:0@lo:400:kworker.0 00010000:00080000:0.0:1788305815.512089:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb3aad80 x1875174015332352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305815.512101:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015332352:0@lo:400:kworker.0 00000100:00100000:3.0:1788305815.512923:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015331712 00000100:00100000:3.0:1788305815.512932:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015331712 00000100:00100000:3.0:1788305815.512985:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788305815.512994:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015331712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305815.513047:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015331712:12345-0@lo:400:kworker.0 Request processed in 55us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305815.513054:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788305815.513073:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015332736 00000100:00100000:3.0:1788305815.513076:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015332736 00000100:00100000:3.0:1788305815.513098:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788305815.513105:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015332736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788305815.513119:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788305815.513151:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015332736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305815.513158:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788305815.513183:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788305815.513188:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305815.513191:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788305815.513234:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015331712:0@lo:400:kworker.0 00000100:00100000:3.0:1788305815.513250:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015332736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305815.517018:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305815.517092:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015332096:0@lo:400:kworker.0 00000100:00100000:1.0:1788305815.517130:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305815.517157:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015332608:0@lo:400:kworker.0 00000100:00100000:1.0:1788305815.517176:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305815.517245:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015331072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305815.517315:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015331584 00000100:00100000:3.0:1788305815.517324:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015331584 00000100:00100000:3.0:1788305815.517398:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788305815.517410:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+24:3650:x1875174015331584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305815.517483:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+24:3650:x1875174015331584:12345-0@lo:400:kworker.0 Request processed in 75us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305815.517493:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788305815.517516:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305815.517736:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015331584:0@lo:400:kworker.0 00000100:00100000:3.0:1788305815.517780:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015331968 00000100:00100000:3.0:1788305815.517784:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015331968 00000100:00100000:3.0:1788305815.517828:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788305815.517835:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015331968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305815.518018:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015332096 00000100:00100000:0.0:1788305815.518024:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015332096 00000100:00100000:0.0:1788305815.518065:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015332608 00000100:00100000:0.0:1788305815.518069:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015332608 00000100:00100000:0.0:1788305815.518106:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788305815.518113:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015332096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305815.518173:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788305815.518184:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015332608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305815.523628:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875174015332480:0@lo:400:kworker.0 00000100:00100000:2.0:1788305815.524748:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305815.525200:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015331968:12345-0@lo:400:kworker.0 Request processed in 7360us (7680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305815.525216:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788305815.527403:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015331968:0@lo:400:kworker.0 00000100:00100000:0.0:1788305815.527671:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015332096:12345-0@lo:400:kworker.0 Request processed in 9555us (10536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305815.527686:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788305815.527723:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015332480 00000100:00100000:0.0:1788305815.527732:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015332480 00000100:00100000:0.0:1788305815.527778:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788305815.527786:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875174015332480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305815.527862:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875174015332480:12345-0@lo:400:kworker.0 Request processed in 76us (3117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305815.527869:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1788305815.527891:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788305815.527914:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788305815.528203:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875174015332480:0@lo:400:kworker.0 00000100:00100000:1.0:1788305815.528422:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015332608:12345-0@lo:400:kworker.0 Request processed in 10239us (11242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305815.528432:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788305815.528543:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015332096:0@lo:400:kworker.0 00010000:00080000:3.0:1788305815.528562:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb3a9880 x1875174015332608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305815.528584:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015332608:0@lo:400:kworker.0 00010000:00010000:0.0:1788305816.150168:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788305817.049690:0:17132:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00080000:0.0:1788305817.049706:0:17132:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:2.0:1788305817.049772:0:17190:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:2.0:1788305817.049795:0:17190:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:2.0:1788305817.173546:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305818.197430:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305819.221644:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305819.605774:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015332864:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788305819.605859:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305819.606206:0:20294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015332864 00000100:00100000:3.0:1788305819.606227:0:20294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015332864 00000100:00100000:3.0:1788305819.606321:0:20294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788305819.606331:0:20294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015332864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788305819.606360:0:20294:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788305819.606413:0:20294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015332864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305819.606420:0:20294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788305819.606568:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015332864:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788305819.606634:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305819.769483:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305819.769537:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305819.769571:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305819.769591:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305819.769611:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305819.769633:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305819.769779:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994285312 00000100:00100000:0.0:1788305819.769789:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994285312 00000100:00100000:0.0:1788305819.769846:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 176 00000100:00100000:0.0:1788305819.769857:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:2395:x1875173994285312:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305819.769941:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:2395:x1875173994285312:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 86us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305819.769950:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 176 00000100:00100000:0.0:1788305819.769985:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994285568 00000100:00100000:0.0:1788305819.769989:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994285568 00000100:00100000:0.0:1788305819.770020:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994285824 00000100:00100000:0.0:1788305819.770023:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994285824 00000100:00100000:0.0:1788305819.770033:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994285440 00000100:00100000:0.0:1788305819.770035:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994285440 00000100:00100000:0.0:1788305819.770048:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994285952 00000100:00100000:0.0:1788305819.770050:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994285952 00000100:00100000:0.0:1788305819.770063:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 105 00000100:00100000:0.0:1788305819.770069:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2395:x1875173994285568:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305819.770101:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2395:x1875173994285568:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 31us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305819.770107:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 105 00000100:00100000:0.0:1788305819.770119:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 106 00000100:00100000:0.0:1788305819.770126:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2395:x1875173994285824:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305819.770166:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2395:x1875173994285824:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 41us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305819.770172:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 106 00000100:00100000:0.0:1788305819.770198:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 107 00000100:00100000:0.0:1788305819.770204:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+12:2395:x1875173994285440:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305819.770229:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+12:2395:x1875173994285440:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 26us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305819.770234:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 107 00000100:00100000:0.0:1788305819.770246:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 108 00000100:00100000:0.0:1788305819.770251:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2395:x1875173994285952:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305819.770272:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2395:x1875173994285952:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 21us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305819.770334:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 108 00000100:00080000:0.0:1788305819.770353:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788305819.770357:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788305819.770572:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994285696 00000100:00100000:1.0:1788305819.770577:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994285696 00000100:00100000:1.0:1788305819.770621:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 38 00000100:00100000:1.0:1788305819.770629:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2395:x1875173994285696:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305819.770659:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2395:x1875173994285696:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 31us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305819.770666:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 38 00000100:00080000:0.0:1788305819.771052:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788305820.246795:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788305820.447768:0:17905:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788305820.633445:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015332992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305820.633555:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305820.633636:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788305820.633642:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015333120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305820.633668:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305820.633714:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015332992 00000100:00100000:3.0:1788305820.633723:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015332992 00000100:00100000:3.0:1788305820.633803:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015333120 00000100:00100000:3.0:1788305820.633807:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015333120 00000100:00100000:3.0:1788305820.633827:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788305820.633836:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015332992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788305820.633866:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788305820.633917:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015332992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305820.633933:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788305820.633952:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788305820.633959:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015333120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305820.633981:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788305820.634008:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015333120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305820.634015:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1788305820.634034:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305820.634039:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305820.634096:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015333120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305820.634108:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015332992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305820.634316:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015333248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788305820.634353:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305820.634399:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015333248 00000100:00100000:1.0:1788305820.634403:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015333248 00000100:00100000:1.0:1788305820.634435:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788305820.634442:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015333248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788305820.634473:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788305820.634511:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015333248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305820.634518:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788305820.634550:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015333248:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305820.634903:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015333760:0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.634935:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305820.634957:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015334272:0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.634984:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305820.635007:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788305820.635012:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:739dca1e-bd16-46de-8d05-a6337c8af843:3647:1875174015333376:0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.635042:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305820.635066:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015333888:0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.635089:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305820.635107:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015334400:0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.635128:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305820.635159:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015333760 00000100:00100000:3.0:1788305820.635164:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015333760 00000100:00100000:3.0:1788305820.635212:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015333888 00000100:00100000:3.0:1788305820.635215:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015333888 00000100:00100000:3.0:1788305820.635238:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788305820.635245:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015333760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.635318:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015333760:12345-0@lo:400:kworker.0 Request processed in 74us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305820.635325:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788305820.635338:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788305820.635344:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015333888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.635370:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015333888:12345-0@lo:400:kworker.0 Request processed in 27us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305820.635376:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788305820.635398:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015334272 00000100:00100000:3.0:1788305820.635401:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015334272 00000100:00100000:3.0:1788305820.635427:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015334400 00000100:00100000:3.0:1788305820.635430:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015334400 00000100:00100000:3.0:1788305820.635448:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788305820.635454:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015334272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.635485:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015334272:12345-0@lo:400:kworker.0 Request processed in 31us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305820.635491:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788305820.635503:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788305820.635509:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015334400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.635534:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015334400:12345-0@lo:400:kworker.0 Request processed in 25us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305820.635539:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788305820.635560:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015333376 00000100:00100000:3.0:1788305820.635569:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015333376 00000100:00100000:3.0:1788305820.635600:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788305820.635605:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+24:3647:x1875174015333376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.635634:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+24:3647:x1875174015333376:12345-0@lo:400:kworker.0 Request processed in 28us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305820.635639:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788305820.635687:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015333632:0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.635716:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305820.635735:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015334144:0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.635753:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305820.635767:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788305820.635772:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015333504:0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.635790:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305820.635802:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015334016:0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.635821:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305820.635830:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bbb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015334528:0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.635847:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305820.635868:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015333632 00000100:00100000:3.0:1788305820.635872:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015333632 00000100:00100000:3.0:1788305820.635894:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788305820.635900:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015333632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.635933:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015333632:12345-0@lo:400:kworker.0 Request processed in 32us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305820.635939:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788305820.635954:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015334144 00000100:00100000:3.0:1788305820.635957:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015334144 00000100:00100000:3.0:1788305820.635982:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015333504 00000100:00100000:3.0:1788305820.635985:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015333504 00000100:00100000:3.0:1788305820.635995:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015334016 00000100:00100000:3.0:1788305820.635997:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015334016 00000100:00100000:3.0:1788305820.636007:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015334528 00000100:00100000:3.0:1788305820.636009:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015334528 00000100:00100000:3.0:1788305820.636023:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788305820.636029:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015334144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.636058:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015334144:12345-0@lo:400:kworker.0 Request processed in 29us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305820.636064:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788305820.636073:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788305820.636079:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015333504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.636100:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015333504:12345-0@lo:400:kworker.0 Request processed in 22us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305820.636106:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788305820.636116:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788305820.636121:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015334016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.636144:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015334016:12345-0@lo:400:kworker.0 Request processed in 23us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305820.636149:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788305820.636159:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788305820.636164:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015334528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.636202:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015334528:12345-0@lo:400:kworker.0 Request processed in 38us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305820.636208:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1788305820.636224:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305820.636234:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788305820.636237:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788305820.636307:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015333504:0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.636319:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015334016:0@lo:400:kworker.0 00010000:00080000:3.0:1788305820.636330:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bbb05180 x1875174015334528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305820.636342:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bbb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015334528:0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.636352:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015333632:0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.636362:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015334144:0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.636395:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:739dca1e-bd16-46de-8d05-a6337c8af843:3647:1875174015333376:0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.636406:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015333888:0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.636415:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015334400:0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.636425:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015333760:0@lo:400:kworker.0 00010000:00080000:3.0:1788305820.636436:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891afb72300 x1875174015334272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305820.636445:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015334272:0@lo:400:kworker.0 00000100:00100000:3.0:1788305820.639671:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788305820.639702:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bbb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015334656:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305820.639791:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305820.639849:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015334656 00000100:00100000:3.0:1788305820.639858:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015334656 00000100:00100000:3.0:1788305820.639912:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788305820.639931:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015334656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788305820.639981:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788305820.640033:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015334656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305820.640041:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788305820.640097:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bbb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015334656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788305820.640216:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305820.640227:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015334784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788305820.640263:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305820.640326:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015334784 00000100:00100000:1.0:1788305820.640331:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015334784 00000100:00100000:1.0:1788305820.640359:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788305820.640373:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015334784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788305820.640390:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788305820.640610:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015334784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 237us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305820.640617:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788305820.640650:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015334784:0@lo:13:osp-pre-1-1.0 00000001:02000400:3.0:1788305820.974782:0:20531:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 19:36:58 (1788305818) 00010000:00010000:3.0:1788305821.271703:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788305822.101547:0:17185:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788305822.101561:0:17185:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788305822.101586:0:17185:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788305822.101595:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788305822.295485:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305823.319379:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305824.341470:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305824.726311:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bbb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015334912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788305824.726386:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305824.726676:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015334912 00000100:00100000:2.0:1788305824.726685:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015334912 00000100:00100000:2.0:1788305824.726770:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788305824.726782:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015334912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788305824.726812:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788305824.726859:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015334912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305824.726867:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788305824.726963:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bbb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015334912:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788305824.727326:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305824.890229:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305824.890303:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305824.890334:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305824.890360:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305824.890381:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305824.890404:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305824.890412:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994286336 00000100:00100000:3.0:1788305824.890422:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994286464 00000100:00100000:2.0:1788305824.890422:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994286336 00000100:00100000:3.0:1788305824.890425:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994286464 00000100:00100000:0.0:1788305824.890486:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994286080 00000100:00100000:0.0:1788305824.890491:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994286080 00000100:00100000:0.0:1788305824.890533:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 178 00000100:00100000:0.0:1788305824.890543:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:2395:x1875173994286080:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305824.890608:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:2395:x1875173994286080:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 66us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305824.890631:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 178 00000100:00100000:1.0:1788305824.890825:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994286592 00000100:00100000:1.0:1788305824.890829:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994286592 00000100:00100000:2.0:1788305824.890871:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994286208 00000100:00100000:2.0:1788305824.890875:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994286208 00000100:00080000:0.0:1788305824.894697:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788305824.894709:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305824.894712:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788305824.894754:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994286720 00000100:00100000:0.0:1788305824.894765:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994286720 00000100:00100000:0.0:1788305824.894835:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 115 00000100:00100000:0.0:1788305824.894846:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2395:x1875173994286336:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305824.894943:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 41 00000100:00100000:3.0:1788305824.894954:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2395:x1875173994286464:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305824.895179:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2395:x1875173994286336:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 335us (4903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305824.895188:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 115 00000100:00100000:0.0:1788305824.895206:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 116 00000100:00100000:0.0:1788305824.895213:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2395:x1875173994286720:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305824.895305:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2395:x1875173994286464:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 352us (4921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305824.895318:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 117 00000100:00100000:1.0:1788305824.895329:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2395:x1875173994286592:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305824.895334:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 41 00000100:00100000:1.0:1788305824.895362:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2395:x1875173994286592:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 36us (5026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305824.895369:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 117 00000100:00080000:1.0:1788305824.895402:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788305824.896326:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2395:x1875173994286720:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 1109us (5917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305824.896335:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 116 00000100:00100000:2.0:1788305824.905244:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 118 00000100:00100000:2.0:1788305824.905260:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+12:2395:x1875173994286208:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305824.905379:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+12:2395:x1875173994286208:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 123us (15016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305824.905402:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 118 00010000:00010000:3.0:1788305825.366541:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305825.749524:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bbb06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015335040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305825.749617:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305825.749919:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015335296:0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.749951:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305825.749978:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015335808:0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.750014:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305825.750030:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015336320:0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.750054:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305825.750071:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788305825.750077:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015335424:0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.750156:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305825.750176:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015335936:0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.750196:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305825.750208:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015336448:0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.750226:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305825.750252:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015335040 00000100:00100000:0.0:1788305825.750259:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015335040 00000100:00100000:0.0:1788305825.750313:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015335296 00000100:00100000:0.0:1788305825.750316:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015335296 00000100:00100000:0.0:1788305825.750329:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788305825.750337:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015335040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788305825.750369:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788305825.750405:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015335040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305825.750412:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788305825.750429:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788305825.750433:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015335296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.750472:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015335296:12345-0@lo:400:kworker.0 Request processed in 38us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305825.750478:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788305825.750494:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015335808 00000100:00100000:0.0:1788305825.750497:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015335808 00000100:00100000:0.0:1788305825.750515:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015335424 00000100:00100000:0.0:1788305825.750516:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015335424 00000100:00100000:0.0:1788305825.750534:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015335936 00000100:00100000:0.0:1788305825.750536:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015335936 00000100:00100000:0.0:1788305825.750546:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788305825.750552:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015335808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.750582:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015335808:12345-0@lo:400:kworker.0 Request processed in 31us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305825.750587:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788305825.750596:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788305825.750600:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015335424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.750618:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015335424:12345-0@lo:400:kworker.0 Request processed in 18us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305825.750622:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788305825.750630:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788305825.750635:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015335936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.750653:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015335936:12345-0@lo:400:kworker.0 Request processed in 19us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305825.750658:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788305825.750671:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015335168:0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.750696:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305825.750715:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015335680:0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.750735:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305825.750748:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015336192:0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.750764:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305825.750778:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788305825.750783:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015335552:0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.750800:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305825.750812:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015336064:0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.750828:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305825.750843:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015336576:0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.750860:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305825.750875:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015335552 00000100:00100000:0.0:1788305825.750878:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015335552 00000100:00100000:0.0:1788305825.750894:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788305825.750900:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015335552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.750927:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015335552:12345-0@lo:400:kworker.0 Request processed in 27us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305825.750933:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788305825.750961:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015335552:0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.750984:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015335424:0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.750992:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015335936:0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.751000:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015335296:0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.751007:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015335808:0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.751025:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015336320 00000100:00100000:0.0:1788305825.751028:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015336320 00000100:00100000:0.0:1788305825.751045:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015336448 00000100:00100000:0.0:1788305825.751047:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015336448 00000100:00100000:0.0:1788305825.751055:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015335680 00000100:00100000:0.0:1788305825.751058:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015335680 00000100:00100000:0.0:1788305825.751065:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015336192 00000100:00100000:0.0:1788305825.751067:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015336192 00000100:00100000:0.0:1788305825.751076:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015336064 00000100:00100000:0.0:1788305825.751078:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015336064 00000100:00100000:0.0:1788305825.751087:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015336576 00000100:00100000:0.0:1788305825.751089:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015336576 00000100:00100000:0.0:1788305825.751101:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788305825.751112:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015336320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.751175:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015336320:12345-0@lo:400:kworker.0 Request processed in 63us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305825.751181:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788305825.751193:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788305825.751200:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015336448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.751225:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015336448:12345-0@lo:400:kworker.0 Request processed in 27us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305825.751231:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788305825.751241:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788305825.751246:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015335680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.751272:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015335680:12345-0@lo:400:kworker.0 Request processed in 26us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305825.751301:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788305825.751313:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788305825.751320:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015336192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.751347:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015336192:12345-0@lo:400:kworker.0 Request processed in 28us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305825.751352:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788305825.751362:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788305825.751367:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015336064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.751390:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015336064:12345-0@lo:400:kworker.0 Request processed in 23us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305825.751395:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788305825.751405:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788305825.751418:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015336576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.751444:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015336576:12345-0@lo:400:kworker.0 Request processed in 28us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305825.751450:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788305825.751476:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015336064:0@lo:400:kworker.0 00010000:00080000:0.0:1788305825.751487:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891afb34700 x1875174015336576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305825.751497:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015336576:0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.751506:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015335680:0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.751514:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015336192:0@lo:400:kworker.0 00000100:00100000:0.0:1788305825.751540:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015336448:0@lo:400:kworker.0 00010000:00080000:0.0:1788305825.751550:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891afb34000 x1875174015336320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305825.751558:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015336320:0@lo:400:kworker.0 00000100:00100000:3.0:1788305825.752152:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015335168 00000100:00100000:3.0:1788305825.752159:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015335168 00000100:00100000:3.0:1788305825.752197:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788305825.752204:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+24:3650:x1875174015335168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305825.752251:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+24:3650:x1875174015335168:12345-0@lo:400:kworker.0 Request processed in 47us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305825.752257:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788305825.752345:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bbb06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015335040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305825.752374:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015335168:0@lo:400:kworker.0 00000100:00100000:2.0:1788305825.753206:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305825.753219:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015336704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305825.753261:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305825.753315:0:20294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015336704 00000100:00100000:2.0:1788305825.753320:0:20294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015336704 00000100:00100000:2.0:1788305825.753355:0:20294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788305825.753363:0:20294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015336704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305825.753386:0:20294:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788305825.753424:0:20294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015336704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305825.753431:0:20294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788305825.753467:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015336704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305825.753728:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015336960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788305825.753759:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305825.753778:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305825.753783:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015336832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305825.753802:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305825.753823:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015336832 00000100:00100000:1.0:1788305825.753827:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015336832 00000100:00100000:1.0:1788305825.753848:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788305825.753863:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015336832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305825.753873:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788305825.753899:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015336832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305825.753905:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788305825.753921:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015336960 00000100:00100000:1.0:1788305825.753924:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015336960 00000100:00100000:1.0:1788305825.753940:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788305825.753944:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015336960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788305825.753962:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788305825.753985:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015336960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 40us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305825.753990:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788305825.754012:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015336832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305825.754020:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015336960:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1788305825.754036:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788305825.754040:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788305825.754043:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788305825.754045:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305825.755404:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015337088:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305825.755450:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305825.755533:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015337088 00000100:00100000:2.0:1788305825.755539:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015337088 00000100:00100000:2.0:1788305825.755581:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788305825.755589:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015337088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788305825.755612:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788305825.755658:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015337088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305825.755665:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788305825.755699:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015337088:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305826.231231:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305826.231366:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305826.231397:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305826.231428:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305826.231579:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994287104 00000100:00100000:1.0:1788305826.231589:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994287104 00000100:00100000:1.0:1788305826.231665:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994287360 00000100:00100000:1.0:1788305826.231669:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994287360 00000100:00100000:1.0:1788305826.231681:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994287232 00000100:00100000:1.0:1788305826.231683:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994287232 00000100:00100000:1.0:1788305826.231698:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:1.0:1788305826.231707:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+15:2395:x1875173994287104:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305826.231740:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305826.231760:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891903f9c00/0x4a426866e6054ae5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08790 expref: 15 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305826.231778:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305826.231830:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+14:2395:x1875173994287104:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 124us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305826.231838:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:1.0:1788305826.231855:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:1.0:1788305826.231862:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:2395:x1875173994287360:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305826.231870:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305826.231878:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891903f8400/0x4a426866e6054b71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08877 expref: 13 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305826.231897:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305826.231915:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+12:2395:x1875173994287360:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 54us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305826.231921:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:1.0:1788305826.231934:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:1.0:1788305826.231940:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+11:2395:x1875173994287232:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305826.231947:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305826.231955:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083c51a00/0x4a426866e6054aec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe087c1 expref: 11 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305826.231964:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305826.231990:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+10:2395:x1875173994287232:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 40us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305826.232003:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:0.0:1788305826.247432:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994286976 00000100:00100000:0.0:1788305826.247450:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994286976 00000100:00100000:0.0:1788305826.247533:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 37 00000100:00100000:0.0:1788305826.247544:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2394:x1875173994286976:12345-192.168.202.55@tcp:9:umount.0 00000020:00000080:0.0:1788305826.247585:0:18928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054b0f 00000020:00010000:0.0:1788305826.247594:0:18928:0:(genops.c:1921:obd_stale_export_put()) Put export ffff88908253a800: total 0 00000100:00080000:0.0:1788305826.247598:0:18928:0:(import.c:65:import_set_state_nolock()) ffff889082538000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1788305826.248953:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:0.0:1788305826.249923:0:18928:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1788305826.250118:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+4:2394:x1875173994286976:12345-192.168.202.55@tcp:9:umount.0 Request processed in 2571us (18892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305826.250827:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 37 00000020:00010000:1.0:1788305826.250950:0:17140:0:(genops.c:1907:obd_stale_export_get()) Get export ffff88908253a800: total 0 00010000:00010000:1.0:1788305826.250954:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305826.251006:0:17140:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88908253a800, canceled 0 locks, left on hash table 1. 00002000:00010000:1.0:1788305826.251039:0:17140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788305826.251042:0:17140:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1788305804 -> 1788305805 00002000:00010000:1.0:1788305826.251045:0:17140:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788305804 -> 1788305805 00002000:00010000:1.0:1788305826.251047:0:17140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788305826.251074:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e6054e7a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08957 expref: 3 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305826.251098:0:17140:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88908253a800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788305826.251110:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305826.251112:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305826.251114:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305826.307725:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305826.307885:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994288256 00000100:00100000:0.0:1788305826.307905:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994288256 00000100:00100000:0.0:1788305826.307993:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 76 00000100:00100000:0.0:1788305826.308004:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+12:2394:x1875173994288256:12345-192.168.202.55@tcp:39:umount.0 00000020:00000080:0.0:1788305826.308037:0:17151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054afa 00000020:00010000:0.0:1788305826.308052:0:17151:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8891b998e000: total 0 00000100:00080000:0.0:1788305826.308057:0:17151:0:(import.c:65:import_set_state_nolock()) ffff8891b998c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788305826.308094:0:17151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:0.0:1788305826.308261:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+11:2394:x1875173994288256:12345-192.168.202.55@tcp:39:umount.0 Request processed in 259us (545us total) trans 8589934637 rc 0/0 00000100:00100000:0.0:1788305826.308269:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 76 00000100:00080000:1.0:1788305826.308743:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:2.0:1788305826.308927:0:17141:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8891b998e000: total 0 00010000:00010000:2.0:1788305826.308996:0:17141:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8891b998e000, canceled 0 locks, left on hash table 7. 00010000:00010000:2.0:1788305826.309035:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:2.0:1788305826.309051:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788305826.309060:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ac00/0x4a426866e6054dcb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0891f expref: 10 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305826.309079:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:2.0:1788305826.309082:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788305826.309085:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebc00/0x4a426866e6054e8f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0895e expref: 9 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305826.309103:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88918c7b0500) 00010000:00010000:2.0:1788305826.309106:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305826.309110:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e6054bc5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0887e expref: 8 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305826.309141:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8890825b9000) 00010000:00010000:2.0:1788305826.309145:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788305826.309156:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6054ca5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088bd expref: 7 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305826.309175:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8890825b9500) 00010000:00010000:2.0:1788305826.309177:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788305826.309181:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054e26 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08934 expref: 6 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305826.309196:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8890825b9a00) 00010000:00010000:2.0:1788305826.309199:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305826.309203:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21600/0x4a426866e6054be1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08885 expref: 5 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305826.309230:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825b9e00) 00010000:00010000:2.0:1788305826.309233:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305826.309237:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6054c20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08893 expref: 4 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305826.309247:0:17141:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8891b998e000, canceled 7 locks, left on hash table 0. 00010000:00010000:2.0:1788305826.309261:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305826.309263:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305826.309265:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305826.324697:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305826.332910:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994288384 00000100:00100000:2.0:1788305826.332925:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994288384 00000100:00080000:1.0:1788305826.333167:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788305826.333352:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 77 00000100:00100000:2.0:1788305826.333368:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2394:x1875173994288384:12345-192.168.202.55@tcp:39:umount.0 00000020:00000080:2.0:1788305826.333402:0:17152:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054b01 00000100:00080000:2.0:1788305826.333421:0:17152:0:(import.c:65:import_set_state_nolock()) ffff8891b998e800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788305826.333451:0:17152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1788305826.333708:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305826.334013:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+3:2394:x1875173994288384:12345-192.168.202.55@tcp:39:umount.0 Request processed in 649us (9392us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788305826.334021:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 77 00010000:00010000:2.0:1788305826.389591:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305827.414492:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305828.437633:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305829.461509:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305829.845739:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305829.845763:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015337216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305829.845830:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305829.846107:0:20294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015337216 00000100:00100000:3.0:1788305829.846116:0:20294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015337216 00000100:00100000:3.0:1788305829.846190:0:20294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788305829.846200:0:20294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015337216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788305829.846243:0:20294:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1788305829.846392:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305829.846465:0:20294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015337216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 266us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305829.846473:0:20294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788305829.846553:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015337216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788305830.001501:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305830.001553:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305830.001874:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305830.001985:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994288640 00000100:00100000:1.0:1788305830.001996:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994288640 00000100:00100000:1.0:1788305830.002070:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994288768 00000100:00100000:1.0:1788305830.002074:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994288768 00000100:00100000:1.0:1788305830.002113:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 125 00000100:00100000:1.0:1788305830.002124:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2397:x1875173994288640:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305830.002197:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2397:x1875173994288640:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 75us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305830.002205:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 125 00000100:00100000:1.0:1788305830.002241:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 126 00000100:00100000:1.0:1788305830.002249:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2397:x1875173994288768:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305830.002322:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2397:x1875173994288768:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 74us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305830.002329:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 126 00000100:00080000:0.0:1788305830.002830:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305830.002835:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305830.003317:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994288512 00000100:00100000:3.0:1788305830.003324:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994288512 00000100:00100000:3.0:1788305830.003375:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 180 00000100:00100000:3.0:1788305830.003383:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+10:2397:x1875173994288512:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305830.003427:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+10:2397:x1875173994288512:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 45us (1873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305830.003434:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 180 00000100:00100000:3.0:1788305830.101819:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305830.101878:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305830.102458:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994289024 00000100:00100000:2.0:1788305830.102463:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994288896 00000100:00100000:1.0:1788305830.102470:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994289024 00000100:00100000:2.0:1788305830.102484:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994288896 00000100:00100000:1.0:1788305830.102548:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:1.0:1788305830.102561:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+11:2398:x1875173994289024:12345-192.168.202.55@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788305830.102565:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:2.0:1788305830.102580:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+11:2398:x1875173994288896:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305830.102581:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305830.102594:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305830.102605:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083c50c00/0x4a426866e6054b2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08831 expref: 11 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305830.102616:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083f20a00/0x4a426866e6054b24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08800 expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305830.102626:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305830.102630:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305830.102681:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+9:2398:x1875173994288896:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 104us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305830.102689:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:1.0:1788305830.109959:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+8:2398:x1875173994289024:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 7388us (8137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305830.109975:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:3.0:1788305830.120019:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305830.120330:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305830.120518:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994289408 00000100:00100000:1.0:1788305830.120529:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994289408 00000100:00100000:1.0:1788305830.120603:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 78 00000100:00100000:1.0:1788305830.120615:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2394:x1875173994289408:12345-192.168.202.55@tcp:39:umount.0 00000020:00000080:1.0:1788305830.120658:0:18524:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054b39 00000020:00010000:1.0:1788305830.120679:0:18524:0:(genops.c:1921:obd_stale_export_put()) Put export ffff88908253c000: total 0 00000100:00080000:1.0:1788305830.120685:0:18524:0:(import.c:65:import_set_state_nolock()) ffff889082538800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788305830.120715:0:18524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000020:00010000:3.0:1788305830.120787:0:17141:0:(genops.c:1907:obd_stale_export_get()) Get export ffff88908253c000: total 0 00010000:00010000:3.0:1788305830.120791:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305830.120835:0:17141:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88908253c000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788305830.120864:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825b9e00) 00010000:00010000:3.0:1788305830.120867:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:1.0:1788305830.120867:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2394:x1875173994289408:12345-192.168.202.55@tcp:39:umount.0 Request processed in 253us (535us total) trans 8589934638 rc 0/0 00010000:00010000:3.0:1788305830.120875:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6054c2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0889a expref: 5 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305830.120895:0:17141:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88908253c000, canceled 1 locks, left on hash table 0. 00000100:00100000:1.0:1788305830.120895:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 78 00010000:00010000:3.0:1788305830.120905:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305830.120906:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305830.120908:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305830.121128:0:19490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994289152 00000100:00100000:2.0:1788305830.121133:0:19490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994289152 00000100:00100000:2.0:1788305830.121176:0:19490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:2.0:1788305830.121184:0:19490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+8:2396:x1875173994289152:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305830.121195:0:19490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305830.121206:0:19490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891903f8000/0x4a426866e6054b6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08870 expref: 8 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305830.121219:0:19490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305830.121239:0:19490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+7:2396:x1875173994289152:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 57us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305830.121246:0:19490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:0.0:1788305830.132460:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305830.132575:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994289536 00000100:00100000:2.0:1788305830.132586:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994289536 00000100:00100000:2.0:1788305830.132654:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 79 00000100:00100000:2.0:1788305830.132671:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2394:x1875173994289536:12345-192.168.202.55@tcp:39:umount.0 00000020:00000080:2.0:1788305830.132730:0:17151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054b40 00000100:00080000:2.0:1788305830.132743:0:17151:0:(import.c:65:import_set_state_nolock()) ffff88908253c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788305830.132775:0:17151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788305830.132911:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+3:2394:x1875173994289536:12345-192.168.202.55@tcp:39:umount.0 Request processed in 247us (460us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788305830.132919:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 79 00010000:00010000:1.0:1788305830.133019:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305830.202403:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305830.202566:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994289792 00000100:00100000:3.0:1788305830.202576:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994289792 00000100:00100000:3.0:1788305830.202630:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 181 00000100:00100000:3.0:1788305830.202641:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+7:2394:x1875173994289792:12345-192.168.202.55@tcp:251:umount.0 00000020:00000080:3.0:1788305830.202798:0:17145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054ad7 00000020:00010000:3.0:1788305830.202806:0:17145:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8890821ad000: total 0 00000100:00080000:3.0:1788305830.202811:0:17145:0:(import.c:65:import_set_state_nolock()) ffff8890821ac000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788305830.202943:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+3:2394:x1875173994289792:12345-192.168.202.55@tcp:251:umount.0 Request processed in 302us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305830.202951:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 181 00000020:00010000:2.0:1788305830.207519:0:17141:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8890821ad000: total 0 00010000:00010000:2.0:1788305830.207601:0:17141:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8890821ad000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788305830.207643:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083f20c00/0x4a426866e6054ade lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08789 expref: 2 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305830.207663:0:17141:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8890821ad000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788305830.207674:0:17141:0:(genops.c:885:class_export_put()) final put ffff8890821ad000/f38dbe3c-89d2-4155-8e7f-a4033c74b7ae 00010000:00010000:2.0:1788305830.207768:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305830.207771:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305830.207773:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788305830.211206:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8890821ad000/f38dbe3c-89d2-4155-8e7f-a4033c74b7ae for MGS 00000020:00000080:1.0:1788305830.211253:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8890821ac000 for MGS 00010000:00010000:2.0:1788305830.492043:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788305830.677905:0:17905:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788305830.869506:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015337344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305830.869580:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305830.871078:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015337472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305830.871137:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305830.871190:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015337472 00000100:00100000:2.0:1788305830.871198:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015337472 00000100:00100000:2.0:1788305830.871249:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788305830.871261:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015337472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305830.871311:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788305830.871358:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015337472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305830.871366:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1788305830.871400:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788305830.871436:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015337472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305830.871756:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015337344 00000100:00100000:3.0:1788305830.871761:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015337344 00000100:00100000:3.0:1788305830.871801:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788305830.871809:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015337344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788305830.871833:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788305830.871883:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015337344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (2303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305830.871889:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788305830.872047:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788305830.872067:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bbb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015337600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305830.872114:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305830.872533:0:20294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015337600 00000100:00100000:3.0:1788305830.872539:0:20294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015337600 00000100:00100000:3.0:1788305830.872574:0:20294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788305830.872581:0:20294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015337600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788305830.872595:0:20294:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788305830.872631:0:20294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015337600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305830.872638:0:20294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788305830.872670:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bbb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015337600:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305830.872772:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015337728:0@lo:400:kworker.0 00000100:00100000:3.0:1788305830.872802:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305830.872825:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015338240:0@lo:400:kworker.0 00000100:00100000:3.0:1788305830.872861:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305830.872878:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015338752:0@lo:400:kworker.0 00000100:00100000:3.0:1788305830.872902:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305830.872918:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788305830.872923:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015338112:0@lo:400:kworker.0 00000100:00100000:3.0:1788305830.872942:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305830.872958:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015338624:0@lo:400:kworker.0 00000100:00100000:3.0:1788305830.872977:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305830.873021:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015337728 00000100:00100000:3.0:1788305830.873026:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015337728 00000100:00100000:3.0:1788305830.873053:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788305830.873072:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+24:3650:x1875174015337728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305830.873116:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+24:3650:x1875174015337728:12345-0@lo:400:kworker.0 Request processed in 46us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305830.873123:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788305830.873149:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015338240 00000100:00100000:3.0:1788305830.873152:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015338240 00000100:00100000:3.0:1788305830.873177:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788305830.873183:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015338240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305830.873212:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015338240:12345-0@lo:400:kworker.0 Request processed in 30us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305830.873218:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788305830.873245:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015338752 00000100:00100000:3.0:1788305830.873248:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015338752 00000100:00100000:3.0:1788305830.873272:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015338112 00000100:00100000:3.0:1788305830.873311:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015338112 00000100:00100000:3.0:1788305830.873325:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015338624 00000100:00100000:3.0:1788305830.873328:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015338624 00000100:00100000:3.0:1788305830.873342:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788305830.873348:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015338752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305830.873379:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015338752:12345-0@lo:400:kworker.0 Request processed in 32us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305830.873385:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788305830.873396:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788305830.873401:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015338112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305830.873425:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015338112:12345-0@lo:400:kworker.0 Request processed in 24us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305830.873430:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788305830.873441:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788305830.873446:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015338624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305830.873477:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015338624:12345-0@lo:400:kworker.0 Request processed in 31us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305830.873482:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788305830.873517:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015338112:0@lo:400:kworker.0 00010000:00080000:3.0:1788305830.873529:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891afb0e680 x1875174015338624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305830.873538:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015338624:0@lo:400:kworker.0 00000100:00100000:3.0:1788305830.873546:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015337728:0@lo:400:kworker.0 00000100:00100000:3.0:1788305830.873563:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015338240:0@lo:400:kworker.0 00000100:00100000:3.0:1788305830.873572:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015338752:0@lo:400:kworker.0 00000100:00080000:0.0:1788305830.873796:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305830.873800:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788305830.873802:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788305830.874245:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015337984:0@lo:400:kworker.0 00000100:00100000:2.0:1788305830.874298:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305830.874319:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015338496:0@lo:400:kworker.0 00000100:00100000:2.0:1788305830.874337:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305830.874363:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788305830.874369:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015337856:0@lo:400:kworker.0 00000100:00100000:2.0:1788305830.874390:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305830.874405:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015338368:0@lo:400:kworker.0 00000100:00100000:2.0:1788305830.874421:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305830.874433:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015338880:0@lo:400:kworker.0 00000100:00100000:2.0:1788305830.874449:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305830.874470:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015337856 00000100:00100000:2.0:1788305830.874474:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015337856 00000100:00100000:2.0:1788305830.874504:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788305830.874512:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015337856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305830.874551:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015337856:12345-0@lo:400:kworker.0 Request processed in 41us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305830.874558:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788305830.874575:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015338496 00000100:00100000:2.0:1788305830.874578:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015338496 00000100:00100000:2.0:1788305830.874604:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015338368 00000100:00100000:2.0:1788305830.874607:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015338368 00000100:00100000:2.0:1788305830.874616:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015338880 00000100:00100000:2.0:1788305830.874618:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015338880 00000100:00100000:2.0:1788305830.874630:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788305830.874646:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015338496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305830.874675:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015338496:12345-0@lo:400:kworker.0 Request processed in 31us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305830.874681:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788305830.874692:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788305830.874697:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015338368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305830.874721:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015338368:12345-0@lo:400:kworker.0 Request processed in 24us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305830.874725:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788305830.874736:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788305830.874742:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015338880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305830.874766:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015338880:12345-0@lo:400:kworker.0 Request processed in 25us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305830.874773:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788305830.874814:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015337344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305830.874859:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015337856:0@lo:400:kworker.0 00000100:00100000:2.0:1788305830.874870:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015338368:0@lo:400:kworker.0 00010000:00080000:2.0:1788305830.874879:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891afb0ce00 x1875174015338880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305830.874887:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015338880:0@lo:400:kworker.0 00000100:00100000:2.0:1788305830.874895:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015338496:0@lo:400:kworker.0 00000100:00100000:0.0:1788305830.874971:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015337984 00000100:00100000:0.0:1788305830.874975:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015337984 00000100:00100000:0.0:1788305830.875031:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788305830.875038:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015337984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305830.875098:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015337984:12345-0@lo:400:kworker.0 Request processed in 61us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305830.875104:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1788305830.875122:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788305830.875126:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305830.875129:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305830.875145:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015337984:0@lo:400:kworker.0 00000100:00100000:2.0:1788305830.875836:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305830.875858:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015339008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305830.875901:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305830.875932:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015339008 00000100:00100000:2.0:1788305830.875936:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015339008 00000100:00100000:2.0:1788305830.875966:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788305830.875973:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015339008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788305830.876222:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788305830.876264:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015339008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 291us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305830.876271:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788305830.876334:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015339008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305830.879511:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788305830.879531:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bbb35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015339136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788305830.879593:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305830.879642:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015339136 00000100:00100000:0.0:1788305830.879649:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015339136 00000100:00100000:0.0:1788305830.879692:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788305830.879701:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015339136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788305830.879735:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788305830.879780:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015339136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305830.879787:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788305830.879832:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bbb35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015339136:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788305831.509444:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788305831.909371:0:17884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 41b2c320-efb9-4bcd-bd61-e9037c280b63 00000001:00080000:3.0:1788305831.909386:0:17884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:3.0:1788305831.909391:0:17884:0:(genops.c:885:class_export_put()) final put ffff889082539000/41b2c320-efb9-4bcd-bd61-e9037c280b63 00000001:00100000:3.0:1788305831.909481:0:17884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0f32c93b-849d-4ca6-ae0d-05edb696d5c1 00000001:00080000:3.0:1788305831.909487:0:17884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:3.0:1788305831.909489:0:17884:0:(genops.c:885:class_export_put()) final put ffff8891b9989800/0f32c93b-849d-4ca6-ae0d-05edb696d5c1 00000020:00000080:3.0:1788305831.909505:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889082539000/41b2c320-efb9-4bcd-bd61-e9037c280b63 for lustre-MDT0001 00000020:00000080:3.0:1788305831.909557:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891b9989800/0f32c93b-849d-4ca6-ae0d-05edb696d5c1 for lustre-MDT0001 00000020:00000080:3.0:1788305831.909578:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88908253c800 for lustre-MDT0001 00000020:00000080:3.0:1788305831.909583:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891b998e800 for lustre-MDT0001 00000001:00100000:2.0:1788305831.915181:0:19473:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0f32c93b-849d-4ca6-ae0d-05edb696d5c1 00000020:00000080:2.0:1788305831.915203:0:19473:0:(genops.c:885:class_export_put()) final put ffff88908253a800/0f32c93b-849d-4ca6-ae0d-05edb696d5c1 00000020:00000080:3.0:1788305831.915544:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88908253a800/0f32c93b-849d-4ca6-ae0d-05edb696d5c1 for lustre-OST0001 00000020:00000080:3.0:1788305831.915602:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889082538000 for lustre-OST0001 00000001:00100000:0.0:1788305831.927577:0:17132:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 41b2c320-efb9-4bcd-bd61-e9037c280b63 00000001:00080000:0.0:1788305831.927598:0:17132:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00000080:0.0:1788305831.927615:0:17132:0:(genops.c:885:class_export_put()) final put ffff88908253c000/41b2c320-efb9-4bcd-bd61-e9037c280b63 00000001:00100000:0.0:1788305831.927639:0:17132:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0f32c93b-849d-4ca6-ae0d-05edb696d5c1 00000001:00080000:0.0:1788305831.927645:0:17132:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:0.0:1788305831.927648:0:17132:0:(genops.c:885:class_export_put()) final put ffff8891b998e000/0f32c93b-849d-4ca6-ae0d-05edb696d5c1 00000020:00000080:2.0:1788305831.927710:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff88908253c000/41b2c320-efb9-4bcd-bd61-e9037c280b63 for lustre-MDT0000 00000020:00000080:2.0:1788305831.927784:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891b998e000/0f32c93b-849d-4ca6-ae0d-05edb696d5c1 for lustre-MDT0000 00000020:00000080:2.0:1788305831.927815:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889082538800 for lustre-MDT0000 00000020:00000080:2.0:1788305831.927820:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891b998c000 for lustre-MDT0000 00000040:00080000:2.0:1788305832.341621:0:17185:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788305832.341635:0:17185:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788305832.341684:0:17185:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788305832.341694:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788305832.535869:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788305832.641896:0:20726:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1788305832.663747:0:20726:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788305832.663826:0:20726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e605469a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60546a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305832.663846:0:20726:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e605469a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60546a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305832.663855:0:20726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e605469a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60546a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305832.663863:0:20726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e605469a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60546a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305832.663889:0:20726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788305832.663895:0:20726:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788305832.663925:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788305832.663932:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788305832.663940:0:20726:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788305832.663974:0:20726:0:(import.c:65:import_set_state_nolock()) ffff88918fd78000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788305832.664084:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875174015339264:0@lo:39:umount.0 00000100:00100000:3.0:1788305832.664192:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305832.664355:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015339264 00000100:00100000:1.0:1788305832.664367:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015339264 00000100:00100000:1.0:1788305832.664433:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788305832.664445:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875174015339264:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788305832.664498:0:17152:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60546cb 00000100:00080000:1.0:1788305832.664509:0:17152:0:(import.c:65:import_set_state_nolock()) ffff8891bf95b800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788305832.664584:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3646:x1875174015339264:12345-0@lo:39:umount.0 Request processed in 140us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305832.664592:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:1.0:1788305832.664603:0:17152:0:(genops.c:885:class_export_put()) final put ffff8891838ee800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788305832.664635:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8891838ee800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788305832.664694:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891bf95b800 for lustre-MDT0000 00000100:00080000:3.0:1788305832.664792:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88918fd78000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788305832.664811:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875174015339264:0@lo:39:umount.0 00000100:00080000:1.0:1788305832.664865:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788305832.664868:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788305832.664873:0:20726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788305832.666792:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305832.666808:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e605469a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60546a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.666823:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181519c00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305832.666848:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e605469a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60546a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.666860:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e605469a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e60546a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305832.666868:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e605469a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e60546a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305832.666875:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788305832.666877:0:17141:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788305832.666882:0:17141:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788305832.666935:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e605469a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60546a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.666943:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305832.666979:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e605469a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60546a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.666987:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e605469a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60546a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.667004:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305832.667006:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305832.667008:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305832.667027:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305832.667049:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015339392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305832.668486:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305832.668586:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015339392 00000100:00100000:2.0:1788305832.668596:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015339392 00000100:00100000:2.0:1788305832.668670:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788305832.668699:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919cba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:739dca1e-bd16-46de-8d05-a6337c8af843+24:3650:x1875174015339392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788305832.668719:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305832.668744:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083f21200/0x4a426866e60546a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e605469a expref: 24 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.668763:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305832.668808:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919cba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:739dca1e-bd16-46de-8d05-a6337c8af843+23:3650:x1875174015339392:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305832.668819:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788305832.668912:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015339392:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305832.670454:0:20726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9800/0x4a426866e60545eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60545f2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305832.670475:0:20726:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9800/0x4a426866e60545eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60545f2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305832.670484:0:20726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9800/0x4a426866e60545eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60545f2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305832.670492:0:20726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff8891903f9800/0x4a426866e60545eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60545f2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305832.670517:0:20726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305832.670525:0:20726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183564c00/0x4a426866e60549f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60549fe expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305832.670532:0:20726:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183564c00/0x4a426866e60549f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60549fe expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305832.670562:0:20726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183564c00/0x4a426866e60549f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60549fe expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305832.670569:0:20726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff889183564c00/0x4a426866e60549f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60549fe expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305832.670581:0:20726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788305832.670589:0:20726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6054ba2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054ba9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305832.670596:0:20726:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6054ba2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054ba9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305832.670602:0:20726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6054ba2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6054ba9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305832.670609:0:20726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6054ba2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6054ba9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305832.670617:0:20726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788305832.670622:0:20726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f8600/0x4a426866e60545dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60545e4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305832.670629:0:20726:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f8600/0x4a426866e60545dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60545e4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305832.670635:0:20726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f8600/0x4a426866e60545dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60545e4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305832.670651:0:20726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff8891903f8600/0x4a426866e60545dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60545e4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305832.670659:0:20726:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1788305832.670663:0:20726:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788305832.670701:0:20726:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788305832.670706:0:20726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788305832.670711:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305832.670718:0:20726:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:1.0:1788305832.670727:0:20726:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff88908211e000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788305832.670733:0:20726:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8891a7e6e000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788305832.670738:0:20726:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff889083e4e000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788305832.670743:0:20726:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8891bf95a000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788305832.670748:0:20726:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff889186223370) has exports, disconnecting them 00000020:00080000:1.0:1788305832.670753:0:20726:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff88908211e000), last request at 1788305830 00000020:00000080:1.0:1788305832.670763:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60549c6 00000100:00080000:1.0:1788305832.670792:0:20726:0:(import.c:65:import_set_state_nolock()) ffff889082119800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788305832.670856:0:20726:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88908211e000): rc 0 00000020:00000080:1.0:1788305832.670859:0:20726:0:(genops.c:885:class_export_put()) final put ffff88908211e000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788305832.670870:0:20726:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8891a7e6e000), last request at 1788305830 00000020:00000080:1.0:1788305832.670872:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054868 00000100:00080000:1.0:1788305832.670878:0:20726:0:(import.c:65:import_set_state_nolock()) ffff8891a7e6d800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788305832.670885:0:20726:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8891a7e6e000): rc 0 00000020:00000080:1.0:1788305832.670887:0:20726:0:(genops.c:885:class_export_put()) final put ffff8891a7e6e000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788305832.670891:0:20726:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff889083e4e000), last request at 1788305738 00000020:00000080:1.0:1788305832.670894:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60547b9 00000100:00080000:1.0:1788305832.670905:0:20726:0:(import.c:65:import_set_state_nolock()) ffff889083e4d800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788305832.670912:0:20726:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff889083e4e000): rc 0 00000020:00000080:1.0:1788305832.670914:0:20726:0:(genops.c:885:class_export_put()) final put ffff889083e4e000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788305832.670918:0:20726:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8891bf95a000), last request at 1788305738 00000020:00000080:1.0:1788305832.670921:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e605475e 00000100:00080000:1.0:1788305832.670925:0:20726:0:(import.c:65:import_set_state_nolock()) ffff88918c9a4000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788305832.670932:0:20726:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00010000:00010000:2.0:1788305832.671762:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788305832.671775:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891903f9800/0x4a426866e60545eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60545f2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.671786:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9800 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305832.671790:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891903f9800/0x4a426866e60545eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60545f2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.671801:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891903f9800/0x4a426866e60545eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e60545f2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305832.671809:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891903f9800/0x4a426866e60545eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e60545f2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305832.671816:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788305832.671820:0:17140:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1788305832.671823:0:17140:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1788305832.671869:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891903f9800/0x4a426866e60545eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60545f2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.671890:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305832.671925:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891903f9800/0x4a426866e60545eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60545f2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.671933:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891903f9800/0x4a426866e60545eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60545f2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.671949:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788305832.671952:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889183564c00/0x4a426866e60549f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60549fe expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.671959:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183564c00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305832.671962:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889183564c00/0x4a426866e60549f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60549fe expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.671970:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889183564c00/0x4a426866e60549f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e60549fe expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305832.671977:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889183564c00/0x4a426866e60549f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e60549fe expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305832.671982:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788305832.671985:0:17140:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788305832.671987:0:17140:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788305832.672001:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889183564c00/0x4a426866e60549f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60549fe expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.672008:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305832.672014:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889183564c00/0x4a426866e60549f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60549fe expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.672051:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889183564c00/0x4a426866e60549f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60549fe expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.672062:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305832.672077:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6054ba2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6054ba9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.672083:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eae00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305832.672086:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6054ba2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6054ba9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.672093:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6054ba2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e6054ba9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305832.672099:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6054ba2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e6054ba9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305832.672104:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788305832.672106:0:17140:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788305832.672108:0:17140:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788305832.672121:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6054ba2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6054ba9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.672127:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305832.672144:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6054ba2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6054ba9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.672151:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6054ba2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6054ba9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.672170:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305832.672174:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891903f8600/0x4a426866e60545dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60545e4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.672180:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8600 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305832.672183:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891903f8600/0x4a426866e60545dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60545e4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.672189:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891903f8600/0x4a426866e60545dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e60545e4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305832.672195:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891903f8600/0x4a426866e60545dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e60545e4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305832.672201:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788305832.672203:0:17140:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788305832.672205:0:17140:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788305832.672217:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891903f8600/0x4a426866e60545dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60545e4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.672223:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305832.672229:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891903f8600/0x4a426866e60545dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60545e4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.672236:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891903f8600/0x4a426866e60545dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60545e4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.672245:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305832.672247:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305832.672255:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305832.672304:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:739dca1e-bd16-46de-8d05-a6337c8af843:3647:1875174015339520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305832.672401:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305832.672464:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305832.672471:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:739dca1e-bd16-46de-8d05-a6337c8af843:3647:1875174015339648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305832.672492:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305832.672533:0:19490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015339520 00000100:00100000:2.0:1788305832.672541:0:19490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015339520 00000100:00100000:2.0:1788305832.672594:0:19490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015339648 00000100:00100000:2.0:1788305832.672598:0:19490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015339648 00000100:00100000:2.0:1788305832.672621:0:19490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788305832.672631:0:19490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9915c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:739dca1e-bd16-46de-8d05-a6337c8af843+24:3647:x1875174015339520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788305832.672649:0:19490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305832.672667:0:19490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181518000/0x4a426866e60545f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e60545eb expref: 24 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.672682:0:19490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305832.672722:0:19490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9915c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:739dca1e-bd16-46de-8d05-a6337c8af843+23:3647:x1875174015339520:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305832.672730:0:19490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788305832.672748:0:19490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788305832.672756:0:19490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9917480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:739dca1e-bd16-46de-8d05-a6337c8af843+22:3647:x1875174015339648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788305832.672763:0:19490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305832.672773:0:19490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083c51800/0x4a426866e60549fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e60549f7 expref: 22 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.672782:0:19490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305832.672802:0:19490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9917480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:739dca1e-bd16-46de-8d05-a6337c8af843+21:3647:x1875174015339648:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305832.672815:0:19490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788305832.672844:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015339776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305832.672870:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305832.672889:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305832.672894:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015339904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305832.672915:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305832.672941:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015339776 00000100:00100000:2.0:1788305832.672945:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015339776 00000100:00100000:2.0:1788305832.672968:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015339904 00000100:00100000:2.0:1788305832.672971:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015339904 00000100:00100000:2.0:1788305832.672986:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788305832.672993:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9915880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:739dca1e-bd16-46de-8d05-a6337c8af843+22:3649:x1875174015339776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788305832.673001:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305832.673011:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083f20600/0x4a426866e6054ba9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e6054ba2 expref: 22 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305832.673020:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305832.673046:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9915880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:739dca1e-bd16-46de-8d05-a6337c8af843+21:3649:x1875174015339776:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305832.673053:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000020:00000080:3.0:1788305832.673150:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88908211e000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788305832.673208:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8891a7e6e000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788305832.673235:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff889083e4e000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788305832.673262:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889082119800 for lustre-MDT0000 00000020:00000080:3.0:1788305832.673268:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891a7e6d800 for lustre-MDT0000 00000020:00000080:3.0:1788305832.673271:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889083e4d800 for lustre-MDT0000 00010000:00010000:3.0:1788305832.673312:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788305832.673498:0:20726:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8891bf95a000): rc 0 00000004:00000080:1.0:1788305832.673510:0:20726:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff94a3c1c7bae0 00000100:00080000:1.0:1788305832.673535:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788305832.673540:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788305832.674897:0:20726:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788305832.674940:0:20726:0:(import.c:65:import_set_state_nolock()) ffff8891bf99f800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788305832.675135:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015340032:0@lo:39:umount.0 00000100:00100000:3.0:1788305832.675222:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305832.675583:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015340032 00000100:00100000:0.0:1788305832.675597:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015340032 00000100:00100000:0.0:1788305832.675662:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788305832.675678:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875174015340032:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788305832.675716:0:17157:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60547e3 00000100:00080000:0.0:1788305832.675725:0:17157:0:(import.c:65:import_set_state_nolock()) ffff88918665d800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1788305832.675912:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788305832.675918:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000001:00000004:0.0:1788305832.677805:0:17157:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788305832.677949:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:739dca1e-bd16-46de-8d05-a6337c8af843:3647:1875174015339648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788305832.677964:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:739dca1e-bd16-46de-8d05-a6337c8af843:3647:1875174015339520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788305832.678057:0:19490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788305832.678082:0:19490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9916300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:739dca1e-bd16-46de-8d05-a6337c8af843+20:3649:x1875174015339904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788305832.678105:0:19490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305832.678135:0:19490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083f21400/0x4a426866e60545e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e60545dd expref: 20 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305832.678159:0:19490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305832.678250:0:19490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9916300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:739dca1e-bd16-46de-8d05-a6337c8af843+19:3649:x1875174015339904:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (5332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305832.678258:0:19490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788305832.679159:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3646:x1875174015340032:12345-0@lo:39:umount.0 Request processed in 3475us (3929us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788305832.679173:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1788305832.679269:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bf99f800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788305832.679307:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015340032:0@lo:39:umount.0 00000100:00100000:2.0:1788305832.679610:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015339904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305832.679624:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015339776:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788305832.680197:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788305832.680759:0:20726:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788305832.680835:0:20726:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788305832.680886:0:20726:0:(import.c:65:import_set_state_nolock()) ffff8891844f9000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788305832.680920:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788305832.680926:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:1.0:1788305832.680949:0:20726:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788305832.681259:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015340160:0@lo:9:umount.0 00000100:00100000:3.0:1788305832.681377:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305832.681560:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015340160 00000100:00100000:0.0:1788305832.681579:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015340160 00000100:00080000:1.0:1788305832.681647:0:20726:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788305832.681665:0:20726:0:(import.c:65:import_set_state_nolock()) ffff88918448e800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788305832.681679:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788305832.681695:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875174015340160:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788305832.681725:0:18928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60548ae 00000020:00080000:1.0:1788305832.681731:0:20726:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff889186223370) has no exports 00000100:00080000:0.0:1788305832.681738:0:18928:0:(import.c:65:import_set_state_nolock()) ffff8891a7e6a000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1788305832.681779:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:0.0:1788305832.681781:0:18928:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788305832.681803:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015340288:0@lo:9:umount.0 00000100:00100000:3.0:1788305832.681840:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305832.681904:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015340288 00000100:00100000:3.0:1788305832.681911:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015340288 00000100:00100000:3.0:1788305832.681956:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788305832.681964:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875174015340288:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788305832.682012:0:18660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054a05 00000100:00080000:3.0:1788305832.682029:0:18660:0:(import.c:65:import_set_state_nolock()) ffff8890821a9800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788305832.682429:0:18660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1788305832.682565:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3646:x1875174015340288:12345-0@lo:9:umount.0 Request processed in 600us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305832.682574:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788305832.682595:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305832.682625:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88918448e800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788305832.682637:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788305832.682639:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788305832.682643:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015340288:0@lo:9:umount.0 00000100:00080000:3.0:1788305832.682943:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891844f9000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788305832.682952:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788305832.682954:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788305832.682957:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015340160:0@lo:9:umount.0 00010000:00010000:2.0:1788305832.682993:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305832.683339:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305832.683439:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3646:x1875174015340160:12345-0@lo:9:umount.0 Request processed in 1190us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305832.683571:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000020:00080000:1.0:1788305832.694806:0:20726:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff889186223370) has no exports 00000020:00000080:1.0:1788305832.792218:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054638 00000020:00000080:1.0:1788305832.792244:0:20726:0:(genops.c:885:class_export_put()) final put ffff88918caa6800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788305832.792398:0:20726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788305832.799542:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88918caa6800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788305832.799613:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788305832.799628:0:20726:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788305832.799634:0:20726:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8891b8fa3370) has no exports 00000020:00000080:3.0:1788305832.800583:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054631 00000020:00000080:3.0:1788305832.800599:0:20726:0:(genops.c:885:class_export_put()) final put ffff8891bfa6e800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788305832.800671:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788305832.800683:0:20726:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788305832.800686:0:20726:0:(genops.c:885:class_export_put()) final put ffff8891bfa6a800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788305832.800689:0:20726:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bfa6a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788305832.800696:0:20726:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788305832.800907:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bfa6e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1788305833.558030:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305834.581666:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305834.967559:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305834.967582:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015340416:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788305834.967660:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305834.968123:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015340416 00000100:00100000:3.0:1788305834.968146:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015340416 00000100:00100000:3.0:1788305834.968215:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788305834.968224:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015340416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788305834.968253:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788305834.968336:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015340416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305834.968343:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1788305834.968412:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305834.968518:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015340416:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788305835.605598:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305835.989976:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015340800:0@lo:400:kworker.0 00000100:00100000:3.0:1788305835.990057:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305835.990084:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015341312:0@lo:400:kworker.0 00000100:00100000:3.0:1788305835.990128:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305835.990153:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788305835.990160:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015340672:0@lo:400:kworker.0 00000100:00100000:3.0:1788305835.990186:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305835.990200:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015341184:0@lo:400:kworker.0 00000100:00100000:3.0:1788305835.990220:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305835.990252:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015341312 00000100:00100000:3.0:1788305835.990259:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015341312 00000100:00100000:3.0:1788305835.990328:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015341184 00000100:00100000:3.0:1788305835.990331:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015341184 00000100:00100000:3.0:1788305835.990348:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788305835.990356:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015341312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305835.990408:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015341312:12345-0@lo:400:kworker.0 Request processed in 53us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305835.990416:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788305835.990434:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788305835.990437:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1875174015341184:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788305835.990451:0:17153:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788305835.990478:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1875174015341184:12345-0@lo:400:kworker.0 Request processed in 39us (257us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788305835.990485:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1788305835.990505:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788305835.990529:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788305835.990533:0:3650:0:(import.c:65:import_set_state_nolock()) ffff889082340000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788305835.990538:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788305835.993682:0:20293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015340800 00000100:00100000:2.0:1788305835.993698:0:20293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015340800 00000100:00100000:2.0:1788305835.993777:0:20293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788305835.993788:0:20293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015340800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305835.993899:0:20293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015340800:12345-0@lo:400:kworker.0 Request processed in 113us (3841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305835.993907:0:20293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788305835.993991:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015340928:0@lo:400:kworker.0 00000100:00100000:2.0:1788305835.994031:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305835.994073:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015341440:0@lo:400:kworker.0 00000100:00100000:2.0:1788305835.994099:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305835.994121:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788305835.994129:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:739dca1e-bd16-46de-8d05-a6337c8af843:3647:1875174015340544:0@lo:400:kworker.0 00000100:00100000:2.0:1788305835.994156:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305835.994183:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015341056:0@lo:400:kworker.0 00000100:00100000:2.0:1788305835.994204:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305835.994229:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015341568:0@lo:400:kworker.0 00000100:00100000:2.0:1788305835.994249:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305835.994267:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015340928 00000100:00100000:2.0:1788305835.994271:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015340928 00000100:00100000:2.0:1788305835.994322:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788305835.994329:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015340928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305835.994360:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015340928:12345-0@lo:400:kworker.0 Request processed in 32us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305835.994367:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788305835.994384:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015340544 00000100:00100000:2.0:1788305835.994402:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015340544 00000100:00100000:2.0:1788305835.994430:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788305835.994436:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+19:3647:x1875174015340544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305835.994466:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+19:3647:x1875174015340544:12345-0@lo:400:kworker.0 Request processed in 30us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305835.994471:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:2.0:1788305835.994502:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788305835.994530:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015341696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305835.994558:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305835.994590:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015341440 00000100:00100000:2.0:1788305835.994593:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015341440 00000100:00100000:2.0:1788305835.994619:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015341056 00000100:00100000:2.0:1788305835.994622:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015341056 00000100:00100000:2.0:1788305835.994630:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015341568 00000100:00100000:2.0:1788305835.994632:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015341568 00000100:00100000:2.0:1788305835.994658:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788305835.994664:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875174015341568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305835.994695:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875174015341568:12345-0@lo:400:kworker.0 Request processed in 31us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305835.994701:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788305835.994714:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788305835.994718:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875174015341440:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788305835.994724:0:17153:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788305835.994749:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875174015341440:12345-0@lo:400:kworker.0 Request processed in 28us (648us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788305835.994754:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788305835.994766:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788305835.994770:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875174015341056:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788305835.994782:0:17153:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788305835.994805:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875174015341056:12345-0@lo:400:kworker.0 Request processed in 34us (600us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788305835.994811:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1788305835.994825:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788305835.994848:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:739dca1e-bd16-46de-8d05-a6337c8af843:3647:1875174015340544:0@lo:400:kworker.0 00000100:00080000:2.0:1788305835.994860:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788305835.994865:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8890820ba000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788305835.994868:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788305835.994874:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8890820ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788305835.994878:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 568 00000100:00080000:2.0:1788305835.994884:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8890820ba000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305835.994905:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891b9915f80 x1875174015341824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788305835.994925:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015341056:0@lo:400:kworker.0 00010000:00080000:2.0:1788305835.994937:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891afb0df80 x1875174015341568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305835.994948:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015341568:0@lo:400:kworker.0 00000100:00100000:2.0:1788305835.994958:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015340928:0@lo:400:kworker.0 00000100:00080000:2.0:1788305835.994966:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788305835.994969:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889082119000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788305835.994972:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788305835.994982:0:3647:0:(import.c:65:import_set_state_nolock()) ffff889082119000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788305835.994986:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 604 00000100:00080000:2.0:1788305835.994991:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff889082119000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305835.995005:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891b9914000 x1875174015341952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788305835.995016:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015341440:0@lo:400:kworker.0 00000100:00100000:2.0:1788305835.995065:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875174015341824:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788305835.995091:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305835.995107:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875174015341952:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788305835.995127:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305835.995147:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015341824 00000100:00100000:2.0:1788305835.995151:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015341824 00000100:00100000:2.0:1788305835.995162:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015341952 00000100:00100000:2.0:1788305835.995164:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015341952 00000100:00100000:2.0:1788305835.995173:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788305835.995176:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875174015341824:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1788305835.995190:0:17153:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788305835.995338:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788305835.995344:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015341952:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1788305835.995352:0:17152:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788305835.995386:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015341952:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 40us (257us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788305835.995392:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1788305835.995415:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889082119000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305835.995419:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788305835.995421:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875174015341952:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788305835.995876:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015340672 00000100:00100000:0.0:1788305835.995881:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015340672 00000100:00100000:0.0:1788305835.995915:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015341696 00000100:00100000:0.0:1788305835.995919:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015341696 00000100:00100000:0.0:1788305835.995943:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788305835.995948:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3650:x1875174015340672:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788305835.995953:0:17894:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788305835.995993:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3650:x1875174015340672:12345-0@lo:400:kworker.0 Request processed in 44us (5806us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788305835.995998:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788305835.996011:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788305835.996016:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1875174015341696:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1788305835.996020:0:17894:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788305835.996055:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1875174015341696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 38us (1496us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788305835.996061:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:02020000:0.0:1788305835.996090:0:3649:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1788305835.996100:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788305835.996104:0:3649:0:(import.c:65:import_set_state_nolock()) ffff88908273e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788305835.996107:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788305835.996113:0:3649:0:(import.c:65:import_set_state_nolock()) ffff88908273e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788305835.996115:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 568 00000100:00080000:0.0:1788305835.996119:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff88908273e000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788305835.996134:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bbb35f80 x1875174015342208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788305835.996155:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305835.996161:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bbb35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015342080:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305835.996187:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305835.996215:0:20294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015342080 00000100:00100000:0.0:1788305835.996218:0:20294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015342080 00000100:00100000:0.0:1788305835.996253:0:20294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788305835.996258:0:20294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015342080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788305835.996321:0:20294:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788305835.996359:0:20294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015342080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305835.996365:0:20294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788305835.996386:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bbb35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015342208:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788305835.996410:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305835.996434:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015342208 00000100:00100000:0.0:1788305835.996437:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015342208 00000100:00100000:0.0:1788305835.996453:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788305835.996458:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1875174015342208:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1788305835.996466:0:17894:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788305835.996493:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1875174015342208:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 34us (82us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788305835.996499:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1788305835.996522:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908273e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305835.996527:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788305835.996529:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bbb35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015342208:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788305835.996555:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bbb35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015342080:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788305836.033677:0:3650:0:(import.c:65:import_set_state_nolock()) ffff889082340000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788305836.033688:0:3650:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 587 00000100:00080000:3.0:1788305836.033698:0:3650:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff889082340000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305836.033853:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889188560380 x1875174015342336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788305836.033880:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015341184:0@lo:400:kworker.0 00000100:00100000:3.0:1788305836.033914:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015340800:0@lo:400:kworker.0 00010000:00080000:3.0:1788305836.033929:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891afb0ce00 x1875174015341312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305836.033939:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015341312:0@lo:400:kworker.0 00000100:00080000:3.0:1788305836.033971:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788305836.033974:0:3650:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff88908273e000 already not connected (conn 2, was 1): DISCONN 00000100:00100000:3.0:1788305836.033979:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015340672:0@lo:400:kworker.0 00000100:00100000:0.0:1788305836.034701:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188560380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875174015342336:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788305836.034777:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305836.046987:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015342336 00000100:00100000:1.0:1788305836.047002:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015342336 00000100:00100000:1.0:1788305836.047076:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788305836.047083:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015342336:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1788305836.047103:0:17152:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788305836.047185:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015342336:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 100us (12406us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788305836.047192:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1788305836.047665:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889082340000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305836.047671:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788305836.047687:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188560380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875174015342336:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788305836.086369:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875174015341824:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 91181us (91267us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788305836.086385:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1788305836.086804:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8890820ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305836.086810:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788305836.086814:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875174015341824:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:3.0:1788305836.631358:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305837.653840:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305838.677606:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788305839.072801:0:17132:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788305839.072828:0:17132:0:(genops.c:885:class_export_put()) final put ffff8891bf95a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788305839.072898:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bf95a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788305839.072973:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88918c9a4000 for lustre-MDT0000 00000001:00100000:3.0:1788305839.080628:0:19473:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788305839.080637:0:19473:0:(genops.c:885:class_export_put()) final put ffff8890821ae000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788305839.081266:0:18655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788305839.081315:0:18655:0:(genops.c:885:class_export_put()) final put ffff8891a7e6c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788305839.082165:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8890821ae000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788305839.082218:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8891a7e6c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788305839.082236:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8890821a9800 for lustre-OST0001 00000020:00000080:1.0:1788305839.082239:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891a7e6a000 for lustre-OST0000 00000001:00100000:0.0:1788305839.087362:0:17884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788305839.087378:0:17884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1788305839.087384:0:17884:0:(genops.c:885:class_export_put()) final put ffff889083183800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788305839.087459:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff889083183800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788305839.087523:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88918665d800 for lustre-MDT0001 00010000:00010000:2.0:1788305839.701574:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305840.085763:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015342464:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305840.085849:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305840.086110:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015342464 00000100:00100000:0.0:1788305840.086127:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015342464 00000100:00100000:0.0:1788305840.086193:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788305840.086202:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015342464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788305840.086230:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1788305840.086363:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305840.089092:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015342464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2881us (3233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305840.089108:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788305840.104206:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015342464:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788305840.725516:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788305840.918959:0:17905:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1788305841.109588:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788305841.109595:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788305841.109599:0:36:0:(import.c:65:import_set_state_nolock()) ffff88908273e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305841.109607:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 666 00000100:00080000:1.0:1788305841.109613:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788305841.109620:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff88908273e000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305841.109643:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb3aa300 x1875174015342720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305841.109684:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788305841.109687:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788305841.109689:0:36:0:(import.c:65:import_set_state_nolock()) ffff8890820ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305841.109693:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 666 00000100:00080000:1.0:1788305841.109696:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788305841.109699:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8890820ba000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305841.109709:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb3a9500 x1875174015343104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305841.109717:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788305841.109719:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788305841.109721:0:36:0:(import.c:65:import_set_state_nolock()) ffff889082340000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305841.109739:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 666 00000100:00080000:1.0:1788305841.109741:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788305841.109745:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff889082340000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305841.109759:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb3ab800 x1875174015343232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305841.109775:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788305841.109777:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788305841.109779:0:36:0:(import.c:65:import_set_state_nolock()) ffff889082119000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305841.109782:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 666 00000100:00080000:1.0:1788305841.109784:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788305841.109787:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff889082119000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305841.109795:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb3a9c00 x1875174015343488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788305841.109828:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015342720:0@lo:38:kworker.0 00000100:00100000:1.0:1788305841.109912:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305841.109975:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875174015343104:0@lo:38:kworker.0 00000100:00100000:1.0:1788305841.110013:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305841.110038:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875174015343232:0@lo:38:kworker.0 00000100:00100000:1.0:1788305841.110059:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305841.110077:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875174015343488:0@lo:38:kworker.0 00000100:00100000:1.0:1788305841.110096:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305841.110146:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015342848:0@lo:400:kworker.0 00000100:00100000:1.0:1788305841.110174:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305841.110192:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305841.110206:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015342976:0@lo:400:kworker.0 00000100:00100000:1.0:1788305841.110228:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305841.110259:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015342720 00000100:00100000:1.0:1788305841.110266:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015342720 00000100:00100000:1.0:1788305841.110322:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788305841.110331:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1875174015342720:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1788305841.110348:0:17894:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788305841.111119:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:739dca1e-bd16-46de-8d05-a6337c8af843:3648:1875174015342592:0@lo:400:kworker.0 00000100:00100000:2.0:1788305841.111176:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305841.111208:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015343616:0@lo:400:kworker.0 00000100:00100000:2.0:1788305841.111233:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305841.111254:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305841.111260:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015343360:0@lo:400:kworker.0 00000100:00100000:2.0:1788305841.111325:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305841.111349:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015342592 00000100:00100000:2.0:1788305841.111354:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015342592 00000100:00100000:2.0:1788305841.111392:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788305841.111400:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+19:3648:x1875174015342592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305841.111449:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+19:3648:x1875174015342592:12345-0@lo:400:kworker.0 Request processed in 50us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305841.111456:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788305841.111485:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015343104 00000100:00100000:2.0:1788305841.111489:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015343104 00000100:00100000:2.0:1788305841.111504:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015343232 00000100:00100000:2.0:1788305841.111507:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015343232 00000100:00100000:2.0:1788305841.111514:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015343488 00000100:00100000:2.0:1788305841.111516:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015343488 00000100:00100000:2.0:1788305841.111523:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015343616 00000100:00100000:2.0:1788305841.111526:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015343616 00000100:00100000:2.0:1788305841.111550:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015343360 00000100:00100000:2.0:1788305841.111552:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015343360 00000100:00100000:2.0:1788305841.111566:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788305841.111572:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015343616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305841.111603:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015343616:12345-0@lo:400:kworker.0 Request processed in 31us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305841.111608:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788305841.111627:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788305841.111632:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015343360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305841.111657:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015343360:12345-0@lo:400:kworker.0 Request processed in 25us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305841.111662:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788305841.111673:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788305841.111677:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875174015343104:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788305841.111689:0:18524:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788305841.111720:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875174015343104:12345-0@lo:38:kworker.0 Request processed in 42us (1706us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788305841.111726:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788305841.111738:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788305841.111742:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875174015343232:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788305841.111748:0:18524:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788305841.111771:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875174015343232:12345-0@lo:38:kworker.0 Request processed in 28us (1711us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788305841.111777:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788305841.111788:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788305841.111792:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875174015343488:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788305841.111798:0:18524:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788305841.111821:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875174015343488:12345-0@lo:38:kworker.0 Request processed in 27us (1723us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788305841.111826:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1788305841.111975:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788305841.112016:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb3ab100 x1875174015343360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305841.112029:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015343360:0@lo:400:kworker.0 00000100:00100000:2.0:1788305841.112047:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:739dca1e-bd16-46de-8d05-a6337c8af843:3648:1875174015342592:0@lo:400:kworker.0 00010000:00080000:2.0:1788305841.112056:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfaa4380 x1875174015343616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305841.112063:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015343616:0@lo:400:kworker.0 00000100:00080000:2.0:1788305841.112099:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8890820ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788305841.112105:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788305841.112108:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875174015343104:0@lo:38:kworker.0 00000100:00080000:2.0:1788305841.113248:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889082340000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788305841.113254:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788305841.113258:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875174015343232:0@lo:38:kworker.0 00000100:00080000:2.0:1788305841.113268:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889082119000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788305841.113271:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788305841.113288:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875174015343488:0@lo:38:kworker.0 00000100:00100000:2.0:1788305841.113346:0:20293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015342848 00000100:00100000:2.0:1788305841.113352:0:20293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015342848 00000100:00100000:2.0:1788305841.113395:0:20293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015342976 00000100:00100000:2.0:1788305841.113398:0:20293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015342976 00000100:00100000:2.0:1788305841.113424:0:20293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788305841.113431:0:20293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015342848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305841.113495:0:20293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015342848:12345-0@lo:400:kworker.0 Request processed in 64us (3320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305841.113501:0:20293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788305841.113516:0:20293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788305841.113522:0:20293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015342976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305841.113578:0:20293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015342976:12345-0@lo:400:kworker.0 Request processed in 56us (3348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305841.113584:0:20293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1788305841.113612:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788305841.113653:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015342976:0@lo:400:kworker.0 00000100:00100000:2.0:1788305841.113665:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015342848:0@lo:400:kworker.0 00000100:00100000:0.0:1788305841.115151:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788305841.115167:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015343744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305841.115231:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305841.115402:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015343744 00000100:00100000:2.0:1788305841.115409:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015343744 00000100:00100000:2.0:1788305841.115457:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788305841.115466:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbb35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015343744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788305841.115491:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788305841.115543:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbb35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015343744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305841.115697:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015343744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305841.115776:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788305841.116298:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1875174015342720:12345-0@lo:38:kworker.0 Request processed in 5965us (6384us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788305841.116309:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1788305841.116692:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908273e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788305841.116698:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788305841.116701:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015342720:0@lo:38:kworker.0 00010000:00010000:2.0:1788305841.753799:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305842.773767:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305843.799066:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305844.821536:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305845.206049:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015343872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788305845.206126:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305845.206292:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015343872 00000100:00100000:1.0:1788305845.206301:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015343872 00000100:00100000:1.0:1788305845.206369:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788305845.206381:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015343872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788305845.206414:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788305845.206460:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015343872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305845.206466:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788305845.206529:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305845.206925:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015343872:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788305845.845513:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788305846.230650:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788305846.230660:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788305846.230665:0:8:0:(import.c:65:import_set_state_nolock()) ffff88908273e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788305846.230693:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 671 00000100:00080000:0.0:1788305846.230701:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788305846.230709:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff88908273e000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305846.230824:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:739dca1e-bd16-46de-8d05-a6337c8af843:3647:1875174015344000:0@lo:400:kworker.0 00000100:00100000:3.0:1788305846.230925:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305846.231610:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015344000 00000100:00100000:2.0:1788305846.231629:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015344000 00000100:00100000:2.0:1788305846.231716:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788305846.231729:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+19:3647:x1875174015344000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305846.231837:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015344128:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788305846.231900:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305846.232172:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891afb37100 x1875174015344256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788305846.232234:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788305846.232239:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788305846.232241:0:8:0:(import.c:65:import_set_state_nolock()) ffff8890820ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788305846.232263:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 671 00000100:00080000:0.0:1788305846.232267:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788305846.232272:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8890820ba000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788305846.232305:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891afb36a00 x1875174015344512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788305846.232316:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788305846.232319:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788305846.232321:0:8:0:(import.c:65:import_set_state_nolock()) ffff889082340000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788305846.232324:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 671 00000100:00080000:0.0:1788305846.232327:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788305846.232331:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff889082340000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788305846.232342:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891afb34700 x1875174015344640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788305846.232358:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788305846.232362:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788305846.232364:0:8:0:(import.c:65:import_set_state_nolock()) ffff889082119000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788305846.232381:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 671 00000100:00080000:0.0:1788305846.232383:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788305846.232387:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff889082119000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305846.232540:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+19:3647:x1875174015344000:12345-0@lo:400:kworker.0 Request processed in 813us (1615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305846.232557:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788305846.232605:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015344128 00000100:00100000:2.0:1788305846.232610:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015344128 00000100:00100000:2.0:1788305846.232651:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788305846.232660:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015344128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788305846.232687:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788305846.232731:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015344128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305846.233028:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015344384:0@lo:400:kworker.0 00000100:00100000:3.0:1788305846.233096:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305846.233140:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788305846.233148:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015344768:0@lo:400:kworker.0 00000100:00100000:3.0:1788305846.233178:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305846.233211:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015344768 00000100:00100000:3.0:1788305846.233224:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015344768 00000100:00100000:3.0:1788305846.233290:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788305846.233299:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015344768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305846.233348:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015344768:12345-0@lo:400:kworker.0 Request processed in 51us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305846.233354:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00010000:00080000:3.0:1788305846.233421:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891afb35500 x1875174015344768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305846.233437:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015344768:0@lo:400:kworker.0 00000100:00100000:0.0:1788305846.234746:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891afb37800 x1875174015344896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788305846.237018:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305846.237026:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788305846.237101:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015344128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305846.237130:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305846.237141:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015345024:0@lo:400:kworker.0 00000100:00100000:0.0:1788305846.237227:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305846.237319:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:739dca1e-bd16-46de-8d05-a6337c8af843:3647:1875174015344000:0@lo:400:kworker.0 00000100:00100000:0.0:1788305846.237356:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015344384 00000100:00100000:0.0:1788305846.237363:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015344384 00000100:00100000:0.0:1788305846.237432:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788305846.237442:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015344384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305846.237498:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015344384:12345-0@lo:400:kworker.0 Request processed in 57us (4402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305846.237505:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788305846.237546:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015344384:0@lo:400:kworker.0 00000100:00100000:0.0:1788305846.237567:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015345024 00000100:00100000:0.0:1788305846.237570:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015345024 00000100:00100000:0.0:1788305846.237603:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788305846.237608:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015345024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305846.237640:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015345024:12345-0@lo:400:kworker.0 Request processed in 31us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305846.237663:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:0.0:1788305846.237676:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788305846.237696:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891afb37480 x1875174015345024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305846.237707:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015345024:0@lo:400:kworker.0 00000100:00100000:2.0:1788305846.237800:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788305846.238044:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015344256:0@lo:38:kworker.0 00000100:00100000:1.0:1788305846.238082:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305846.238110:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875174015344512:0@lo:38:kworker.0 00000100:00100000:1.0:1788305846.238131:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305846.238152:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875174015344640:0@lo:38:kworker.0 00000100:00100000:1.0:1788305846.238191:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305846.238212:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875174015344896:0@lo:38:kworker.0 00000100:00100000:1.0:1788305846.238231:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305846.238259:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015344512 00000100:00100000:1.0:1788305846.238263:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015344512 00000100:00100000:1.0:1788305846.238301:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015344640 00000100:00100000:1.0:1788305846.238303:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015344640 00000100:00100000:1.0:1788305846.238311:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015344896 00000100:00100000:1.0:1788305846.238313:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015344896 00000100:00100000:1.0:1788305846.238321:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788305846.238327:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015344512:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1788305846.238343:0:17152:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788305846.240521:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015344512:12345-0@lo:38:kworker.0 Request processed in 2183us (2378us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788305846.240536:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788305846.240574:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788305846.240580:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015344640:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1788305846.240597:0:17152:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788305846.240619:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015344640:12345-0@lo:38:kworker.0 Request processed in 39us (2428us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788305846.240625:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788305846.240634:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788305846.240639:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015344896:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1788305846.240645:0:17152:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788305846.240661:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015344896:12345-0@lo:38:kworker.0 Request processed in 22us (2429us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788305846.240666:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1788305846.240731:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8890820ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305846.240736:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788305846.240756:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875174015344512:0@lo:38:kworker.0 00000100:00080000:1.0:1788305846.240768:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889082340000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305846.240771:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788305846.240774:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875174015344640:0@lo:38:kworker.0 00000100:00080000:1.0:1788305846.240782:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889082119000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305846.240785:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788305846.240788:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875174015344896:0@lo:38:kworker.0 00000100:00100000:2.0:1788305846.242448:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015344256 00000100:00100000:2.0:1788305846.242466:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015344256 00000100:00100000:2.0:1788305846.242529:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788305846.242539:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875174015344256:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788305846.242559:0:17156:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788305846.242663:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875174015344256:12345-0@lo:38:kworker.0 Request processed in 124us (4579us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788305846.242671:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788305846.245541:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908273e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788305846.245575:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788305846.245582:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015344256:0@lo:38:kworker.0 00010000:00010000:3.0:1788305846.871707:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000400:3.0:1788305847.253789:0:20726:0:(genops.c:1852:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? 00000020:01000000:3.0:1788305847.282076:0:20726:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8890810883c0 - data ffff88919dc62af8/ffff8891bbaae800 00000020:01000000:3.0:1788305847.282353:0:20726:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff889186568480 - data ffff88918ac97510/ffff8891c05d8800 00000001:00000004:3.0:1788305847.310960:0:20726:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000100:00080000:1.0:1788305847.402793:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788305847.402807:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788305847.402830:0:20726:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8891bb3a9f80 x1875174015340032/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788305842 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305847.402863:0:20726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788305847.410497:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788305847.410512:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1788305847.410532:0:20726:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788305847.410535:0:20726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788305847.415978:0:17175:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788305847.415990:0:17175:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1788305847.416014:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1788305847.417027:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788305847.417036:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1788305847.417058:0:20726:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788305847.417062:0:20726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788305847.418201:0:17177:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788305847.418209:0:17177:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:2.0:1788305847.418235:0:17177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788305847.421771:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054600 00000020:00000080:1.0:1788305847.421790:0:20726:0:(genops.c:885:class_export_put()) final put ffff8891af3f8000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788305847.422640:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8891af3f8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788305847.425035:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054615 00000020:00000080:1.0:1788305847.425054:0:20726:0:(genops.c:885:class_export_put()) final put ffff8891bf99b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788305847.425075:0:20726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788305847.425081:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305847.425091:0:20726:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788305847.425097:0:20726:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff889186220000) has no exports 00000004:01000000:1.0:1788305847.425886:0:20726:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788305847.425901:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054677 00000020:00000080:1.0:1788305847.425909:0:20726:0:(genops.c:885:class_export_put()) final put ffff8891834c1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788305847.425916:0:20726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788305847.425921:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305847.425928:0:20726:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788305847.425962:0:20726:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8891862719b8) has no exports 00000020:00000080:1.0:1788305847.425972:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054670 00000020:00000080:1.0:1788305847.425977:0:20726:0:(genops.c:885:class_export_put()) final put ffff889184489800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788305847.426418:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bf99b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788305847.426430:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8891834c1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788305847.426437:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff889184489800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788305847.427251:0:20726:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788305847.427260:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788305847.427265:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1788305847.427502:0:20726:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788305847.427506:0:20726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788305847.427631:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305847.427644:0:20726:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788305847.427653:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054662 00000020:00000080:1.0:1788305847.427662:0:20726:0:(genops.c:885:class_export_put()) final put ffff889184488000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788305847.436660:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88918448e800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788305847.436683:0:8:0:(genops.c:885:class_export_put()) final put ffff889184489000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788305847.436688:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff889184489000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788305847.436700:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788305847.445296:0:20726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788305847.445318:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305847.445335:0:20726:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788305847.445342:0:20726:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8890833d8000) has no exports 00000020:00000080:1.0:1788305847.445356:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e605465b 00000020:00000080:1.0:1788305847.445369:0:20726:0:(genops.c:885:class_export_put()) final put ffff8891844fc800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788305847.452601:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff889184488000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788305847.453884:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8891844fc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788305847.454345:0:20726:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788305847.454352:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788305847.454358:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1788305847.454367:0:20726:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788305847.454370:0:20726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788305847.454401:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891844f9000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788305847.454426:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305847.454438:0:20726:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788305847.454445:0:20726:0:(genops.c:885:class_export_put()) final put ffff8891bf99c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788305847.454465:0:20726:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bf99c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788305847.454475:0:20726:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788305847.454596:0:20726:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788305847.454618:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e605464d 00000020:00000080:1.0:1788305847.454627:0:20726:0:(genops.c:885:class_export_put()) final put ffff8891bf99b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788305847.454641:0:20726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788305847.454646:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305847.454653:0:20726:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788305847.454657:0:20726:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff889186274d28) has no exports 00000020:00000080:3.0:1788305847.454658:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bf99b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788305847.454665:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054646 00000020:00000080:1.0:1788305847.454669:0:20726:0:(genops.c:885:class_export_put()) final put ffff8891bf999800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788305847.454695:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bf999800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788305847.456468:0:20726:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788305847.456478:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788305847.456483:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788305847.456491:0:20726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788305847.456550:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788305847.456562:0:20726:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788305847.456617:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891bf99f800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788305847.456631:0:8:0:(genops.c:885:class_export_put()) final put ffff8891bf99d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788305847.456635:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bf99d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788305847.456642:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788305847.456780:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788305847.456785:0:20726:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788305847.456790:0:20726:0:(genops.c:885:class_export_put()) final put ffff8891869aa000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788305847.456793:0:20726:0:(genops.c:844:class_export_destroy()) destroying export ffff8891869aa000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788305847.456798:0:20726:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788305847.456909:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e605461c 00000020:00000080:2.0:1788305847.456917:0:20726:0:(genops.c:885:class_export_put()) final put ffff8891bf99c800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788305847.456941:0:20726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788305847.456949:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788305847.456954:0:20726:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788305847.456958:0:20726:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8891862219b8) has no exports 00000020:00000080:2.0:1788305847.456982:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788305847.456985:0:20726:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788305847.456990:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054623 00000020:00000080:2.0:1788305847.456995:0:20726:0:(genops.c:885:class_export_put()) final put ffff8891bf999000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788305847.457005:0:20726:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889182f56000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788305847.457009:0:20726:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889182f56000 3 00000020:01000004:2.0:1788305847.457013:0:20726:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff889182f56000 from lustre-MDT0000 00000020:00000080:2.0:1788305847.457034:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788305847.457052:0:20726:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788305847.457055:0:20726:0:(genops.c:885:class_export_put()) final put ffff8891af3fc000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788305847.457058:0:20726:0:(genops.c:844:class_export_destroy()) destroying export ffff8891af3fc000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788305847.457066:0:20726:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788305847.457099:0:20726:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788305847.457103:0:20726:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788305847.457106:0:20726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788305847.457109:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788305847.457112:0:20726:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788305847.457120:0:20726:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8891bb1bc800 739dca1e-bd16-46de-8d05-a6337c8af843 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788305847.457124:0:20726:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff889186224d28) has exports, disconnecting them 00000020:00080000:2.0:1788305847.457129:0:20726:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8891bb1bc800), last request at 1788305718 00000020:00000080:2.0:1788305847.457147:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60545c8 00000020:00010000:2.0:1788305847.457151:0:20726:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8891bb1bc800: total 2 00000100:00080000:2.0:1788305847.457156:0:20726:0:(import.c:65:import_set_state_nolock()) ffff8891bb1bf000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788305847.457175:0:20726:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8891bb1bc800): rc 0 00000020:00080000:2.0:1788305847.457179:0:20726:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff889186224d28) has no exports 00000020:00010000:2.0:1788305847.457191:0:17140:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8891bb1bc800: total 2 00010000:00010000:2.0:1788305847.457195:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305847.457219:0:17140:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8891bb1bc800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788305847.457255:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083c51400/0x4a426866e6054987 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e6054980 expref: 14 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305847.457313:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181518600/0x4a426866e60546e7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e60546e0 expref: 13 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305847.457328:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181518800/0x4a426866e6054703 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e60546fc expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305847.457339:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889183564600/0x4a426866e60549b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e60549aa expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305847.457364:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083f21a00/0x4a426866e60545d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e60545cf expref: 10 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305847.457374:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889183564200/0x4a426866e60549f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e60549e9 expref: 9 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305847.457384:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891903f8200/0x4a426866e6054853 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e605484c expref: 8 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305847.457396:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891903f9200/0x4a426866e6054b7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e6054b78 expref: 7 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305847.457406:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083f21c00/0x4a426866e60547a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e605479d expref: 6 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305847.457415:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181519800/0x4a426866e60546f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e60546ee expref: 5 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305847.457426:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083c50e00/0x4a426866e6054b8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e6054b86 expref: 4 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305847.457437:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083f20200/0x4a426866e6054b9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e6054b94 expref: 3 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305847.457449:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891903f8a00/0x4a426866e6054829 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e6054822 expref: 2 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305847.457458:0:17140:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8891bb1bc800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1788305847.457473:0:17140:0:(genops.c:885:class_export_put()) final put ffff8891bb1bc800/739dca1e-bd16-46de-8d05-a6337c8af843 00010000:00010000:2.0:1788305847.457478:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305847.457486:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305847.457488:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305847.457552:0:17145:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8890833c6c00:17145] 0 exiting: rc = 1 00000100:00100000:2.0:1788305847.457673:0:17147:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8891b8ede400:17147] 2 exiting: rc = 0 00000100:00100000:2.0:1788305847.457746:0:17146:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8891b8ede200:17146] 1 exiting: rc = 0 00000100:00100000:2.0:1788305847.457807:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457815:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457821:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457829:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457835:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457841:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457847:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457854:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457860:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457867:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457874:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457879:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457886:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457892:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457898:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457906:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457913:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457920:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457928:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457946:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457953:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457959:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457965:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457972:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457978:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457986:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457992:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.457998:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458003:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458017:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458024:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458030:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458036:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458042:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458048:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458053:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458059:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458065:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458071:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458077:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458082:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458087:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458093:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458097:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458102:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458108:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458114:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458120:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458126:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458135:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458143:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458149:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458156:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458163:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458169:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458177:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458184:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458190:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458196:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458201:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458206:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458211:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458216:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305847.458222:0:20726:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788305847.459228:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bf99c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788305847.459241:0:8:0:(genops.c:885:class_export_put()) final put ffff8891af3fa000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788305847.459244:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8891af3fa000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788305847.459251:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788305847.459360:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bf999000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788305847.459367:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bb1bc800/739dca1e-bd16-46de-8d05-a6337c8af843 for MGS 00000020:00000080:3.0:1788305847.459412:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891bb1bf000 for MGS 00000020:01000000:2.0:1788305847.465211:0:20726:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff889188572e40 - data ffff88919defb438/ffff8891a44e1400 00000020:01000000:2.0:1788305847.465409:0:20726:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88918a512d20 - data ffff88919df58bd0/ffff8891c05d4400 00000020:00000080:2.0:1788305847.466258:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60545ac 00000020:00000080:2.0:1788305847.466272:0:20726:0:(genops.c:885:class_export_put()) final put ffff8891bb1b8800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788305847.466323:0:20726:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889182f56000 from MGS, refs=2 00000020:01000004:2.0:1788305847.466327:0:20726:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889182f56000 2 00000020:01000004:2.0:1788305847.466331:0:20726:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff889182f56000 from MGS 00000020:00000080:2.0:1788305847.466359:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788305847.466369:0:20726:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788305847.466372:0:20726:0:(genops.c:885:class_export_put()) final put ffff8891bb1bc000/MGS 00000020:00000080:2.0:1788305847.466375:0:20726:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bb1bc000/MGS for MGS 00000020:01000000:2.0:1788305847.466384:0:20726:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788305847.466472:0:20726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788305847.466476:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788305847.466482:0:20726:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788305847.466491:0:20726:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff88918fd7b000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788305847.466498:0:20726:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8891bb4f3370) has exports, disconnecting them 00000020:00080000:2.0:1788305847.466505:0:20726:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff88918fd7b000), last request at 1788305719 00000020:00000080:2.0:1788305847.466510:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60546af 00000020:00080000:2.0:1788305847.466523:0:20726:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88918fd7b000): rc 0 00000020:00000080:2.0:1788305847.466529:0:20726:0:(genops.c:885:class_export_put()) final put ffff88918fd7b000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788305847.469302:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bb1b8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788305847.469323:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff88918fd7b000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788305847.470373:0:20726:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788305847.470383:0:20726:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788305847.470389:0:20726:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788305847.470397:0:20726:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788305847.470426:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88918fd78000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788305847.470631:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788305847.470651:0:20726:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788305847.470658:0:20726:0:(genops.c:885:class_export_put()) final put ffff88918fd7e000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788305847.470662:0:20726:0:(genops.c:844:class_export_destroy()) destroying export ffff88918fd7e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788305847.470673:0:20726:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788305847.470785:0:20726:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889182f56000 1 00000020:00000080:3.0:1788305847.470791:0:20726:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e605459e 00000020:00000080:3.0:1788305847.470799:0:20726:0:(genops.c:885:class_export_put()) final put ffff8891bb1b8000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788305847.470809:0:20726:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788305847.471098:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bb1b8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788305847.471114:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788305847.471120:0:20726:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788305847.471124:0:20726:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8891b8fa0000) has no exports 00000020:00000080:3.0:1788305847.536649:0:20726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788305847.536669:0:20726:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788305847.536676:0:20726:0:(genops.c:885:class_export_put()) final put ffff889182f57000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788305847.536682:0:20726:0:(genops.c:844:class_export_destroy()) destroying export ffff889182f57000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788305847.536821:0:20726:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788305847.537191:0:20726:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff889182f56800 00000020:02000400:3.0:1788305847.537340:0:20726:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788305847.893765:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305848.917999:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305849.946560:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788305850.135157:0:17905:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788305850.329366:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015345152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788305850.329437:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305850.329555:0:20294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015345152 00000100:00100000:1.0:1788305850.329563:0:20294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015345152 00000100:00100000:1.0:1788305850.329621:0:20294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788305850.329629:0:20294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015345152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788305850.329657:0:20294:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788305850.329699:0:20294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015345152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305850.329705:0:20294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788305850.333629:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015345152:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788305850.334346:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788305850.989645:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788305851.354630:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788305851.354637:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788305851.354641:0:8:0:(import.c:65:import_set_state_nolock()) ffff88908273e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305851.354649:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 676 00000100:00080000:1.0:1788305851.354664:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788305851.354679:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff88908273e000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305851.354704:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bfaa7b80 x1875174015345408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305851.354747:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788305851.354751:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788305851.354753:0:8:0:(import.c:65:import_set_state_nolock()) ffff8890820ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305851.354756:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 676 00000100:00080000:1.0:1788305851.354759:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788305851.354763:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8890820ba000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305851.354776:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bfaa4700 x1875174015345792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305851.354785:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788305851.354788:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788305851.354790:0:8:0:(import.c:65:import_set_state_nolock()) ffff889082340000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305851.354793:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 676 00000100:00080000:1.0:1788305851.354795:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788305851.354798:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff889082340000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305851.354809:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bfaa4380 x1875174015345920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305851.354842:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788305851.354846:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788305851.354847:0:8:0:(import.c:65:import_set_state_nolock()) ffff889082119000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305851.354851:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 676 00000100:00080000:1.0:1788305851.354853:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788305851.354862:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff889082119000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305851.354875:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb23fb80 x1875174015346176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788305851.354926:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015345408:0@lo:38:kworker.0 00000100:00100000:1.0:1788305851.354992:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305851.355047:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875174015345792:0@lo:38:kworker.0 00000100:00100000:1.0:1788305851.355074:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305851.355098:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875174015345920:0@lo:38:kworker.0 00000100:00100000:1.0:1788305851.355119:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305851.355136:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875174015346176:0@lo:38:kworker.0 00000100:00100000:1.0:1788305851.355155:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305851.355189:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015345664:0@lo:400:kworker.0 00000100:00100000:1.0:1788305851.355215:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305851.355241:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788305851.355246:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015346048:0@lo:400:kworker.0 00000100:00100000:1.0:1788305851.355298:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305851.355330:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015345792 00000100:00100000:1.0:1788305851.355337:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015345792 00000100:00100000:1.0:1788305851.355362:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015345920 00000100:00100000:1.0:1788305851.355364:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015345920 00000100:00100000:1.0:1788305851.355563:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015346176 00000100:00100000:1.0:1788305851.355567:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015346176 00000100:00100000:1.0:1788305851.355580:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015346048 00000100:00100000:1.0:1788305851.355582:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015346048 00000100:00100000:1.0:1788305851.355614:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788305851.355624:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015346048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305851.355762:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015345280:0@lo:400:kworker.0 00000400:00000100:0.0:1788305851.355791:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875174015345280 offset 0 length 224: 4 00000100:00100000:0.0:1788305851.355812:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015346304:0@lo:400:kworker.0 00000100:00100000:0.0:1788305851.355834:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305851.355848:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305851.355853:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015345536:0@lo:400:kworker.0 00000100:00100000:0.0:1788305851.355873:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305851.355921:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015345408 00000100:00100000:0.0:1788305851.355925:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015345408 00000100:00100000:0.0:1788305851.355948:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788305851.355954:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875174015345408:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788305851.355973:0:17157:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788305851.356562:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015346048:12345-0@lo:400:kworker.0 Request processed in 938us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305851.356571:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788305851.356587:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015346304 00000100:00100000:1.0:1788305851.356590:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015346304 00000100:00100000:1.0:1788305851.356611:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788305851.356616:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015346304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305851.356650:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015346304:12345-0@lo:400:kworker.0 Request processed in 34us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305851.357713:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788305851.357736:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788305851.357742:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015345792:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788305851.357759:0:17152:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788305851.357806:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015345792:12345-0@lo:38:kworker.0 Request processed in 62us (2731us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788305851.357813:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788305851.357826:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788305851.357831:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015345920:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788305851.357841:0:17152:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788305851.357867:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015345920:12345-0@lo:38:kworker.0 Request processed in 35us (2747us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788305851.357873:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788305851.357886:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788305851.357891:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015346176:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788305851.357912:0:17152:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788305851.357944:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015346176:12345-0@lo:38:kworker.0 Request processed in 52us (2788us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788305851.357949:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788305851.357982:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015345664 00000100:00100000:1.0:1788305851.357987:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015345664 00000100:00100000:1.0:1788305851.358023:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015345536 00000100:00100000:1.0:1788305851.358026:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015345536 00000100:00100000:1.0:1788305851.358046:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788305851.358053:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015345664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305851.358088:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015345664:12345-0@lo:400:kworker.0 Request processed in 35us (2871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305851.358094:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788305851.358105:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788305851.358111:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015345536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305851.358138:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015345536:12345-0@lo:400:kworker.0 Request processed in 27us (2264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305851.358144:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788305851.358160:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788305851.358164:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788305851.358192:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8891bb23c700 x1875174015346048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305851.358205:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015346048:0@lo:400:kworker.0 00000100:00100000:1.0:1788305851.358218:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015345664:0@lo:400:kworker.0 00000100:00080000:1.0:1788305851.361363:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8890820ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305851.361445:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788305851.361451:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875174015345792:0@lo:38:kworker.0 00000100:00080000:1.0:1788305851.361627:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889082340000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305851.361632:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788305851.361635:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875174015345920:0@lo:38:kworker.0 00000100:00080000:1.0:1788305851.361645:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889082119000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305851.361649:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788305851.361652:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875174015346176:0@lo:38:kworker.0 00000100:00100000:2.0:1788305851.366510:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015345536:0@lo:400:kworker.0 00010000:00080000:2.0:1788305851.366532:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8891bb23c380 x1875174015346304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305851.366544:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015346304:0@lo:400:kworker.0 00000100:00100000:2.0:1788305851.370445:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305851.370474:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015346432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305851.370562:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305851.370752:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015346432 00000100:00100000:1.0:1788305851.370761:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015346432 00000100:00100000:1.0:1788305851.370819:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788305851.370830:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015346432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788305851.370860:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788305851.370921:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015346432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305851.370928:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788305851.375525:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015346432:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305851.427378:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875174015345408:12345-0@lo:38:kworker.0 Request processed in 71412us (72375us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788305851.427394:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1788305851.427453:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908273e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305851.427459:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788305851.427463:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015345408:0@lo:38:kworker.0 00000020:01000004:1.0:1788305851.880495:0:20930:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1788305851.895410:0:20930:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788305851.895466:0:20930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e605479d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60547a4 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305851.895481:0:20930:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e605479d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60547a4 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305851.895488:0:20930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e605479d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60547a4 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305851.895495:0:20930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e605479d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60547a4 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305851.895536:0:20930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788305851.895542:0:20930:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788305851.895573:0:20930:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788305851.895578:0:20930:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788305851.895584:0:20930:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788305851.895590:0:20930:0:(import.c:65:import_set_state_nolock()) ffff8890820ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788305851.895595:0:20930:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788305851.895596:0:20930:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788305851.895600:0:20930:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788305851.896610:0:20930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f8e00/0x4a426866e60546fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054703 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305851.896624:0:20930:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f8e00/0x4a426866e60546fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054703 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305851.896631:0:20930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f8e00/0x4a426866e60546fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6054703 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305851.896638:0:20930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff8891903f8e00/0x4a426866e60546fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6054703 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305851.896661:0:20930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788305851.896666:0:20930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183565e00/0x4a426866e60549e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60549f0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305851.896673:0:20930:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183565e00/0x4a426866e60549e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60549f0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305851.896693:0:20930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183565e00/0x4a426866e60549e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60549f0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305851.896698:0:20930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff889183565e00/0x4a426866e60549e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60549f0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305851.896706:0:20930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788305851.896712:0:20930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054b94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054b9b expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305851.896719:0:20930:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054b94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054b9b expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305851.896725:0:20930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054b94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6054b9b expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305851.896732:0:20930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054b94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6054b9b expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305851.896739:0:20930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788305851.896744:0:20930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9a00/0x4a426866e60546ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60546f5 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305851.896751:0:20930:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9a00/0x4a426866e60546ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60546f5 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305851.896757:0:20930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9a00/0x4a426866e60546ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60546f5 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305851.896773:0:20930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff8891903f9a00/0x4a426866e60546ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60546f5 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305851.896781:0:20930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:1.0:1788305851.896785:0:20930:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1788305851.896809:0:20930:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1788305851.896814:0:20930:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1788305851.896817:0:20930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305851.896823:0:20930:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788305851.896829:0:20930:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff889082346000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788305851.896835:0:20930:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8891a7e69800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788305851.896841:0:20930:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8891b8fa4d28) has exports, disconnecting them 00000020:00080000:1.0:1788305851.896845:0:20930:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff889082346000), last request at 1788305851 00000020:00000080:1.0:1788305851.896852:0:20930:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60549db 00000100:00080000:1.0:1788305851.896871:0:20930:0:(import.c:65:import_set_state_nolock()) ffff889082118800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788305851.896930:0:20930:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff889082346000): rc 0 00000020:00000080:1.0:1788305851.896933:0:20930:0:(genops.c:885:class_export_put()) final put ffff889082346000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1788305851.896942:0:20930:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8891a7e69800), last request at 1788305851 00000020:00000080:1.0:1788305851.896945:0:20930:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e605487d 00000100:00080000:1.0:1788305851.896950:0:20930:0:(import.c:65:import_set_state_nolock()) ffff8891a7e6f000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788305851.896955:0:20930:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8891a7e69800): rc 0 00000020:00000080:1.0:1788305851.896957:0:20930:0:(genops.c:885:class_export_put()) final put ffff8891a7e69800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1788305851.896963:0:20930:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffff94a3c1cd7ae0 00000100:00080000:1.0:1788305851.896980:0:20930:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788305851.896989:0:20930:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8891b9914e00 x1875174015341696/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788305851 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305851.897010:0:20930:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788305851.897937:0:20930:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788305851.897944:0:20930:0:(import.c:65:import_set_state_nolock()) ffff88908273e000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788305851.898076:0:20930:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788305851.898079:0:20930:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788305851.898090:0:20930:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788305851.898159:0:20930:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788305851.898182:0:20930:0:(import.c:65:import_set_state_nolock()) ffff88908273a000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788305851.898196:0:20930:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788305851.898198:0:20930:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788305851.898204:0:20930:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788305851.898259:0:20930:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788305851.898267:0:20930:0:(import.c:65:import_set_state_nolock()) ffff8891894cc000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788305851.898325:0:20930:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8891b8fa4d28) has no exports 00000100:00100000:2.0:1788305851.898856:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015341696:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788305851.899570:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788305851.899581:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e605479d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60547a4 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.899608:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51600 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:3.0:1788305851.899612:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e605479d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60547a4 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.899621:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e605479d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e60547a4 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305851.899628:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e605479d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e60547a4 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305851.899645:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788305851.899649:0:17141:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788305851.899652:0:17141:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788305851.899690:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e605479d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60547a4 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.899696:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788305851.899725:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e605479d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60547a4 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.899732:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e605479d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60547a4 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.899744:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788305851.899747:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891903f8e00/0x4a426866e60546fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6054703 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.899753:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8e00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:3.0:1788305851.899755:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891903f8e00/0x4a426866e60546fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6054703 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.899769:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891903f8e00/0x4a426866e60546fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e6054703 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305851.899776:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891903f8e00/0x4a426866e60546fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e6054703 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305851.899781:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788305851.899783:0:17141:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1788305851.899785:0:17141:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1788305851.899798:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891903f8e00/0x4a426866e60546fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6054703 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.899804:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788305851.899810:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891903f8e00/0x4a426866e60546fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6054703 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.899816:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891903f8e00/0x4a426866e60546fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6054703 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.899824:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788305851.899827:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889183565e00/0x4a426866e60549e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60549f0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.899832:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183565e00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:3.0:1788305851.899834:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889183565e00/0x4a426866e60549e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60549f0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.899840:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889183565e00/0x4a426866e60549e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e60549f0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305851.899856:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889183565e00/0x4a426866e60549e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e60549f0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305851.899861:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788305851.899863:0:17141:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788305851.899865:0:17141:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788305851.899879:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889183565e00/0x4a426866e60549e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60549f0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.899884:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788305851.899913:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889183565e00/0x4a426866e60549e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60549f0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.899919:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889183565e00/0x4a426866e60549e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60549f0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.899934:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788305851.899937:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054b94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6054b9b expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.899943:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb800 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:3.0:1788305851.899946:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054b94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6054b9b expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.899953:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054b94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e6054b9b expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305851.899960:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054b94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e6054b9b expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305851.899976:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788305851.899978:0:17141:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788305851.899980:0:17141:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788305851.899996:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054b94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6054b9b expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.900001:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788305851.900007:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054b94 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6054b9b expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.900013:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054b94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6054b9b expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.900022:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305851.900025:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891903f9a00/0x4a426866e60546ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60546f5 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.900030:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9a00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:3.0:1788305851.900032:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891903f9a00/0x4a426866e60546ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60546f5 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.900039:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891903f9a00/0x4a426866e60546ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e60546f5 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305851.900044:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891903f9a00/0x4a426866e60546ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e60546f5 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305851.900049:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788305851.900051:0:17141:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788305851.900052:0:17141:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788305851.900071:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891903f9a00/0x4a426866e60546ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60546f5 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.900076:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788305851.900080:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891903f9a00/0x4a426866e60546ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60546f5 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.900086:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891903f9a00/0x4a426866e60546ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60546f5 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305851.900096:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305851.900098:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305851.900100:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788305851.900123:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889082346000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788305851.900171:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891a7e69800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788305851.900194:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889082118800 for lustre-MDT0001 00000020:00000080:3.0:1788305851.900199:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891a7e6f000 for lustre-MDT0001 00000100:00100000:3.0:1788305851.900301:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:739dca1e-bd16-46de-8d05-a6337c8af843:3648:1875174015346944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788305851.900379:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305851.900424:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788305851.900431:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:739dca1e-bd16-46de-8d05-a6337c8af843:3648:1875174015346816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788305851.900452:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305851.900468:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:739dca1e-bd16-46de-8d05-a6337c8af843:3648:1875174015347328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788305851.900487:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305851.900508:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015347200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788305851.900528:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305851.900544:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305851.900549:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015347072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788305851.900577:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305851.900603:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015346944 00000100:00100000:3.0:1788305851.900610:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015346944 00000100:00100000:3.0:1788305851.900635:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015346816 00000100:00100000:3.0:1788305851.900637:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015346816 00000100:00100000:3.0:1788305851.900644:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015347328 00000100:00100000:3.0:1788305851.900646:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015347328 00000100:00100000:3.0:1788305851.900653:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015347200 00000100:00100000:3.0:1788305851.900655:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015347200 00000100:00100000:3.0:1788305851.900661:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015347072 00000100:00100000:3.0:1788305851.900663:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015347072 00000100:00100000:3.0:1788305851.900674:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788305851.900681:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3648:x1875174015346944:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788305851.900688:0:17138:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788305851 with bad export cookie 5350954098424628680 00000100:00100000:2.0:1788305851.904298:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788305851.904312:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188561500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1875174015346816:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788305851.904321:0:17137:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788305851 with bad export cookie 5350954098424628680 00010000:00010000:0.0:1788305851.904502:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305851.904521:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015346560:0@lo:9:umount.0 00000100:00100000:0.0:1788305851.904585:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305851.904625:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015346688:0@lo:9:umount.0 00000100:00100000:0.0:1788305851.904660:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305851.904696:0:20293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015346560 00000100:00100000:0.0:1788305851.904703:0:20293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015346560 00000100:00100000:0.0:1788305851.904741:0:20293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015346688 00000100:00100000:0.0:1788305851.904744:0:20293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015346688 00000100:00100000:0.0:1788305851.904761:0:20293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788305851.904767:0:20293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875174015346560:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788305851.904790:0:20293:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60548a7 00000100:00080000:0.0:1788305851.904802:0:20293:0:(import.c:65:import_set_state_nolock()) ffff8891834d4000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788305851.904859:0:20293:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788305851.905461:0:20293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3646:x1875174015346560:12345-0@lo:9:umount.0 Request processed in 692us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305851.905471:0:20293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788305851.905487:0:20293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788305851.905494:0:20293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875174015346688:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788305851.905507:0:20293:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054a0c 00000100:00080000:0.0:1788305851.905514:0:20293:0:(import.c:65:import_set_state_nolock()) ffff8890821ab800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788305851.905536:0:20293:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1788305851.905608:0:20293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3646:x1875174015346688:12345-0@lo:9:umount.0 Request processed in 115us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305851.905614:0:20293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1788305851.905630:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788305851.905772:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908273a000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788305851.905793:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788305851.905795:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788305851.905799:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015346560:0@lo:9:umount.0 00000100:00080000:0.0:1788305851.905809:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891894cc000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788305851.905817:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788305851.905819:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788305851.905821:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015346688:0@lo:9:umount.0 00000100:00100000:2.0:1788305851.906150:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188561500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1875174015346816:12345-0@lo:103:ldlm_bl.0 Request processed in 1837us (5694us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788305851.906158:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788305851.906177:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788305851.906181:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919cba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1875174015347328:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788305851.906187:0:17137:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788305851 with bad export cookie 5350954098424628680 00000100:00100000:2.0:1788305851.906212:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919cba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1875174015347328:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (5725us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788305851.906218:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788305851.906228:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788305851.906232:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188561f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3650:x1875174015347200:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788305851.906236:0:17137:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788305851 with bad export cookie 5350954098424628680 00000100:00100000:2.0:1788305851.906264:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188561f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3650:x1875174015347200:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (5735us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788305851.906269:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788305851.906297:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788305851.906301:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188560000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3650:x1875174015347072:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788305851.906305:0:17137:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788305851 with bad export cookie 5350954098424628680 00000100:00100000:2.0:1788305851.906335:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188560000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3650:x1875174015347072:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (5757us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788305851.906340:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788305851.906428:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.155@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788305851.906432:0:3650:0:(import.c:65:import_set_state_nolock()) ffff889083f77000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788305851.906435:0:3650:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788305851.906499:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.155@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:3.0:1788305851.919952:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305851.920078:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3648:x1875174015346944:12345-0@lo:103:ldlm_bl.0 Request processed in 19391us (19709us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788305851.920089:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788305851.938160:0:3650:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.155@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788305851.938165:0:3650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788305851.938174:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8891bfaa5f80 x1875174015345280/t0(0) o400->MGC192.168.202.155@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788305867 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305851.938201:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889188561880 x1875174015346944/t0(0) o103->MGC192.168.202.155@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788305867 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305851.938212:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889188563480 x1875174015346816/t0(0) o103->MGC192.168.202.155@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788305867 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305851.938220:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889188563800 x1875174015347328/t0(0) o103->MGC192.168.202.155@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788305867 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305851.938228:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889188562a00 x1875174015347200/t0(0) o103->MGC192.168.202.155@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788305867 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305851.938237:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889188562300 x1875174015347072/t0(0) o103->MGC192.168.202.155@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788305867 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305851.938810:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015345280:0@lo:400:kworker.0 10000000:01000000:2.0:1788305851.938854:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788305851.938857:0:3650:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788305851.938858:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788305851.939016:0:3648:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff889083f77000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1788305851.939056:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:739dca1e-bd16-46de-8d05-a6337c8af843:3648:1875174015347328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305851.939064:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:739dca1e-bd16-46de-8d05-a6337c8af843:3648:1875174015346944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305851.939099:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:739dca1e-bd16-46de-8d05-a6337c8af843:3648:1875174015346816:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788305851.939220:0:3650:0:(import.c:65:import_set_state_nolock()) ffff889083f77000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788305851.939226:0:3650:0:(import.c:510:import_select_connection()) MGC192.168.202.155@tcp: connect to NID 0@lo last attempt 548 00000100:00080000:2.0:1788305851.939234:0:3650:0:(import.c:624:import_select_connection()) MGC192.168.202.155@tcp: import ffff889083f77000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305851.939532:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891b9914e00 x1875174015347456/t0(0) o250->MGC192.168.202.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788305851.939605:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015347200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305851.939621:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015347072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305851.939732:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:739dca1e-bd16-46de-8d05-a6337c8af843:3646:1875174015347456:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:0.0:1788305851.939780:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875174015347456 offset 0 length 520: 4 00000020:00080000:2.0:1788305851.942141:0:20930:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8891b8fa4d28) has no exports 00010000:00010000:0.0:1788305851.990634:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788305852.041314:0:20930:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff889081088240 - data ffff88919dc62a20/ffff8891be1e0800 00000020:01000000:3.0:1788305852.041490:0:20930:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8891865685a0 - data ffff88919dcc66c0/ffff8891bb8e9800 00000001:00000004:1.0:1788305852.056505:0:20930:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:1.0:1788305852.146240:0:20930:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788305852.146249:0:20930:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788305852.146257:0:20930:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788305852.147939:0:20930:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788305852.147946:0:20930:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1788305852.148009:0:20930:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788305852.148012:0:20930:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788305852.159781:0:17892:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788305852.159791:0:17892:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1788305852.159807:0:17892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1788305852.161702:0:20930:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788305852.161711:0:20930:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1788305852.161731:0:20930:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788305852.161734:0:20930:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788305852.162849:0:17895:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788305852.162855:0:17895:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1788305852.162876:0:17895:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788305852.164447:0:20930:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054711 00000020:00000080:1.0:1788305852.164459:0:20930:0:(genops.c:885:class_export_put()) final put ffff8891bf95f800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788305852.165215:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bf95f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788305852.165264:0:20930:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054726 00000020:00000080:1.0:1788305852.165342:0:20930:0:(genops.c:885:class_export_put()) final put ffff889183842800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788305852.165806:0:20930:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1788305852.165814:0:20930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305852.165822:0:20930:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788305852.165826:0:20930:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8891b8fa19b8) has no exports 00000004:01000000:1.0:1788305852.165985:0:20930:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788305852.165994:0:20930:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e605477a 00000020:00000080:1.0:1788305852.166000:0:20930:0:(genops.c:885:class_export_put()) final put ffff88919402e800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788305852.166004:0:20930:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788305852.166008:0:20930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305852.166012:0:20930:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788305852.166015:0:20930:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff889186273370) has no exports 00000020:00000080:1.0:1788305852.166020:0:20930:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054773 00000020:00000080:1.0:1788305852.166024:0:20930:0:(genops.c:885:class_export_put()) final put ffff8891894c9800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788305852.166094:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff889183842800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1788305852.166102:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88919402e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788305852.166107:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8891894c9800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788305852.167322:0:20930:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788305852.167329:0:20930:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788305852.167334:0:20930:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788305852.167340:0:20930:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788305852.167342:0:20930:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788305852.167393:0:20930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305852.167403:0:20930:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788305852.167409:0:20930:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054765 00000020:00000080:1.0:1788305852.167416:0:20930:0:(genops.c:885:class_export_put()) final put ffff88919402f000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788305852.167421:0:20930:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788305852.167425:0:20930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305852.167429:0:20930:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788305852.167433:0:20930:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff889186270000) has no exports 00000020:00000080:1.0:1788305852.167438:0:20930:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054757 00000020:00000080:1.0:1788305852.167441:0:20930:0:(genops.c:885:class_export_put()) final put ffff88908273c000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788305852.167814:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891894cc000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788305852.167822:0:8:0:(genops.c:885:class_export_put()) final put ffff88919402e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788305852.167834:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88919402e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788305852.167841:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788305852.167938:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88919402f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788305852.167944:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88908273c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788305852.169102:0:20930:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788305852.169109:0:20930:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788305852.169113:0:20930:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788305852.169130:0:20930:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788305852.169132:0:20930:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788305852.169181:0:20930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305852.169192:0:20930:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788305852.169206:0:20930:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788305852.169213:0:20930:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054749 00000020:00000080:1.0:1788305852.169221:0:20930:0:(genops.c:885:class_export_put()) final put ffff88919402d000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788305852.169226:0:20930:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788305852.169233:0:20930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305852.169237:0:20930:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788305852.169241:0:20930:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8890833d99b8) has no exports 00000020:00000080:1.0:1788305852.169246:0:20930:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054742 00000020:00000080:1.0:1788305852.169250:0:20930:0:(genops.c:885:class_export_put()) final put ffff88908273d800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788305852.169357:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88908273a000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788305852.169364:0:8:0:(genops.c:885:class_export_put()) final put ffff88919402b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788305852.169366:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88919402b800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788305852.169372:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788305852.169427:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88919402d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788305852.169431:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88908273d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788305852.170659:0:20930:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788305852.170666:0:20930:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788305852.170670:0:20930:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788305852.170676:0:20930:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788305852.170713:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88908273e000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788305852.170717:0:20930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788305852.170725:0:20930:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788305852.170729:0:20930:0:(genops.c:885:class_export_put()) final put ffff88908273f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788305852.170732:0:20930:0:(genops.c:844:class_export_destroy()) destroying export ffff88908273f800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1788305852.170745:0:20930:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788305852.170884:0:20930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788305852.170898:0:20930:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788305852.170901:0:20930:0:(genops.c:885:class_export_put()) final put ffff889083187000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788305852.170903:0:20930:0:(genops.c:844:class_export_destroy()) destroying export ffff889083187000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788305852.170908:0:20930:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788305852.170990:0:20930:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e605472d 00000020:00000080:0.0:1788305852.170996:0:20930:0:(genops.c:885:class_export_put()) final put ffff889183842000/lustre-MDD0001_UUID 00000020:01000000:0.0:1788305852.171011:0:20930:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788305852.171015:0:20930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788305852.171020:0:20930:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788305852.171023:0:20930:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8891bdc44d28) has no exports 00000020:00000080:3.0:1788305852.171040:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff889183842000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1788305852.171040:0:20930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788305852.171043:0:20930:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788305852.171046:0:20930:0:(genops.c:885:class_export_put()) final put ffff889083e7e800/lustre-MDD0001_UUID 00000020:00000080:0.0:1788305852.171048:0:20930:0:(genops.c:844:class_export_destroy()) destroying export ffff889083e7e800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1788305852.171051:0:20930:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1788305852.171160:0:20930:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054734 00000020:00000080:0.0:1788305852.171165:0:20930:0:(genops.c:885:class_export_put()) final put ffff889183845000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788305852.171183:0:20930:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88918c9a0800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788305852.171187:0:20930:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88918c9a0800 2 00000020:01000004:0.0:1788305852.171190:0:20930:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88918c9a0800 from lustre-MDT0001 00000020:00000080:0.0:1788305852.171213:0:20930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788305852.171217:0:20930:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788305852.171220:0:20930:0:(genops.c:885:class_export_put()) final put ffff8891bf958000/lustre-MDT0001_UUID 00000020:00000080:0.0:1788305852.171222:0:20930:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bf958000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788305852.171229:0:20930:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788305852.171256:0:20930:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788305852.171260:0:20930:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788305852.171262:0:20930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788305852.171265:0:20930:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788305852.171295:0:20930:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8890820bb800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788305852.171301:0:20930:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8891b917b370) has exports, disconnecting them 00000020:00080000:0.0:1788305852.171305:0:20930:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8890820bb800), last request at 1788305738 00000020:00000080:0.0:1788305852.171309:0:20930:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60547b2 00000020:00080000:0.0:1788305852.171318:0:20930:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8890820bb800): rc 0 00000020:00000080:0.0:1788305852.171322:0:20930:0:(genops.c:885:class_export_put()) final put ffff8890820bb800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788305852.171843:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff889183845000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788305852.171851:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8890820bb800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1788305852.291507:0:20930:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1788305852.291516:0:20930:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788305852.291521:0:20930:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788305852.291528:0:20930:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788305852.291756:0:20930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788305852.291764:0:20930:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1788305852.291772:0:20930:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88918c9a0800 1 00000020:00000080:0.0:1788305852.291779:0:20930:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60546d9 00000020:00000080:0.0:1788305852.291787:0:20930:0:(genops.c:885:class_export_put()) final put ffff8891894cd000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788305852.291820:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8890820ba000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788305852.291827:0:8:0:(genops.c:885:class_export_put()) final put ffff8890820b8000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788305852.291830:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8890820b8000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788305852.291841:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:0.0:1788305852.295879:0:20930:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1788305852.295903:0:20930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788305852.295913:0:20930:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788305852.295918:0:20930:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8891bb4f0000) has no exports 00000020:00000080:3.0:1788305852.297127:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8891894cd000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788305852.333812:0:20930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788305852.333826:0:20930:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788305852.333831:0:20930:0:(genops.c:885:class_export_put()) final put ffff88918c9a1800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788305852.333836:0:20930:0:(genops.c:844:class_export_destroy()) destroying export ffff88918c9a1800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788305852.333849:0:20930:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788305852.333977:0:20930:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff88918c9a5000 00000020:01000000:0.0:1788305852.333999:0:20930:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788305852.334003:0:20930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788305852.334007:0:20930:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788305852.334010:0:20930:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8891bb4f19b8) has no exports 00000100:00100000:3.0:1788305852.334172:0:17151:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff88918a510800:17151] 0 exiting: rc = 1 00000100:00100000:1.0:1788305852.336532:0:17152:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8891b8edf600:17152] 1 exiting: rc = 0 00000100:00100000:1.0:1788305852.336650:0:17153:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8891b8edf800:17153] 2 exiting: rc = 0 00000100:00100000:1.0:1788305852.336716:0:18524:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8891b9811a00:18524] 3 exiting: rc = 0 00000100:00100000:0.0:1788305852.336983:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.336991:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337012:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337017:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337022:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337028:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337033:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337038:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337043:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337048:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337053:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337058:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337063:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337068:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337072:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337080:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337085:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337090:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337096:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337101:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337107:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337114:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337120:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337124:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337131:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337137:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337142:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337148:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337154:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337161:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337168:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337174:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337180:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337187:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337192:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337197:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337205:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337219:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337237:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337243:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337249:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337255:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337261:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337267:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337272:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337392:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337399:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337405:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337411:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337417:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337423:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337428:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337433:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337439:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337444:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337449:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337456:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337462:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337467:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337473:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337478:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337484:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337492:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.337498:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.345563:0:17155:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8891b8edf200:17155] 1 exiting: rc = 0 00000100:00100000:3.0:1788305852.350403:0:17154:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8891b8edfa00:17154] 0 exiting: rc = 1 00000100:00100000:1.0:1788305852.350549:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350558:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350564:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350571:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350576:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350581:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350585:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350591:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350596:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350601:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350606:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350611:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350616:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350621:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350627:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350632:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350664:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350669:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350674:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350679:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350685:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350690:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350695:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350700:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350705:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350711:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350716:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350833:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350841:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350846:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350851:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350856:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350861:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350866:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350871:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350876:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350881:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350902:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350912:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350919:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350924:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350930:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350935:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350940:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350946:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350951:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350956:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350961:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350967:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350972:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350977:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350991:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.350997:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.351002:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.351008:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.351014:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.351019:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.351025:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.351030:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.351035:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.351039:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.351045:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.351050:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.351055:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.351490:0:17156:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff889082046e00:17156] 0 exiting: rc = 1 00000100:00100000:3.0:1788305852.351878:0:17894:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8891bb8e2c00:17894] 2 exiting: rc = 0 00000100:00100000:0.0:1788305852.352032:0:17157:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff889186397600:17157] 1 exiting: rc = 0 00000100:00100000:1.0:1788305852.353457:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.353467:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.353476:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.353490:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.353497:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.353503:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.353511:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.353518:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.353525:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.353531:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.353537:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.353544:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.353550:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.353556:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.353562:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.353582:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.353591:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.353597:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.353605:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.353612:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.353619:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.353638:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.353644:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354037:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354044:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354050:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354058:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354081:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354089:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354094:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354101:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354107:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354113:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354118:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354125:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354130:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354137:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354143:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354150:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354170:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354176:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354182:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354187:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354194:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354199:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354205:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354211:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354217:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354977:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354987:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.354993:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.355017:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.355024:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.355031:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.355038:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.355044:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.355061:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.355067:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.355073:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.355080:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.355086:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.355092:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.355098:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.355105:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.389035:0:17158:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8891badf3c00:17158] 0 exiting: rc = 1 00000100:00100000:1.0:1788305852.389124:0:17159:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8891badf3e00:17159] 1 exiting: rc = 0 00000100:00100000:0.0:1788305852.392202:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392211:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392216:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392234:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392240:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392246:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392251:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392270:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392296:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392303:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392308:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392313:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392318:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392323:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392327:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392333:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392338:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392343:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392348:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392353:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392358:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392363:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392367:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392372:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392377:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392382:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392387:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392391:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392396:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392401:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392406:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392411:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392416:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392421:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392426:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392431:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392436:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392442:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392446:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392452:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392456:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392461:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392473:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392478:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392483:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392488:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392493:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392498:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392504:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392509:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392515:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392521:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392526:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392531:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392535:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392540:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392546:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392551:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392556:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392561:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392566:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392571:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392576:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305852.392581:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.394533:0:17160:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8891badf3600:17160] 0 exiting: rc = 1 00000100:00100000:0.0:1788305852.394822:0:17161:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8891badf3400:17161] 1 exiting: rc = 0 00000100:00100000:1.0:1788305852.395127:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395136:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395141:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395145:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395151:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395156:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395161:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395166:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395171:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395177:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395182:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395187:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395191:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395196:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395201:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395206:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395211:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395216:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395230:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395236:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395240:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395246:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395251:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395256:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395260:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395303:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395308:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395312:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395316:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395321:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395325:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395330:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395334:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395339:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395344:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395348:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395353:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395357:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395362:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395367:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395371:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395376:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395380:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395385:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395389:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395394:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395398:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395402:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395407:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395411:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395416:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395420:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395425:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395430:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395435:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395439:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395443:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395447:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395452:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395456:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395468:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395472:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395476:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305852.395481:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398393:0:17162:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff889186396a00:17162] 0 exiting: rc = 1 00000100:00100000:1.0:1788305852.398596:0:17163:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff889186396400:17163] 1 exiting: rc = 0 00000100:00100000:3.0:1788305852.398755:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398762:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398776:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398782:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398787:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398792:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398797:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398802:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398807:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398811:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398816:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398821:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398826:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398831:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398835:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398840:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398844:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398849:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398853:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398858:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398862:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398866:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398870:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398875:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398879:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398883:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398899:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398904:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398909:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398913:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398918:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398923:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398927:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398932:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398936:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398941:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398946:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398958:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398963:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398968:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398974:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398978:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398984:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398989:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.398995:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.399001:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.399007:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.399012:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.399018:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.399023:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.399029:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.399034:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.399040:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.399046:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.399051:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.399056:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.399061:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.399067:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.399072:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.399077:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.399083:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.399088:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.399093:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.399099:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.399569:0:17165:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff88918a510200:17165] 1 exiting: rc = 0 00000100:00100000:3.0:1788305852.399953:0:17166:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8891bb0dd600:17166] 2 exiting: rc = 0 00000100:00100000:1.0:1788305852.400167:0:17164:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8891bb0dd200:17164] 0 exiting: rc = 1 00000100:00100000:3.0:1788305852.400327:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400333:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400340:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400346:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400361:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400368:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400382:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400388:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400394:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400400:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400405:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400410:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400416:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400422:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400428:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400433:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400439:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400445:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400451:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400456:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400462:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400484:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400490:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400495:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400500:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400506:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400511:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400517:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400523:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400529:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400536:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400542:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400548:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400554:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400560:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400565:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400572:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400577:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400582:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400588:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400594:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400607:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400613:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400618:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400624:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400643:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400976:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400984:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400990:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.400995:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.401001:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.401007:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.401012:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.401019:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.401025:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.401030:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.401037:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.401042:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.401047:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.401053:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.401059:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.401064:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.401070:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305852.401077:0:20930:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788305852.407495:0:20930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788305852.407507:0:20930:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788305852.407513:0:20930:0:(genops.c:885:class_export_put()) final put ffff889083f70000/MDS_uuid 00000020:00000080:3.0:1788305852.407518:0:20930:0:(genops.c:844:class_export_destroy()) destroying export ffff889083f70000/MDS_uuid for MDS 00000020:01000000:3.0:1788305852.407527:0:20930:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788305852.407679:0:20930:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1788305853.014138:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305854.039029:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305855.062012:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305856.085412:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788305856.470821:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 739dca1e-bd16-46de-8d05-a6337c8af843->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788305856.470830:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 739dca1e-bd16-46de-8d05-a6337c8af843->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788305856.470834:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788305856.470838:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788305856.470841:0:36:0:(import.c:65:import_set_state_nolock()) ffff889082340000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788305856.470859:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 681 00000100:00080000:2.0:1788305856.470864:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788305856.470871:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff889082340000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305856.470906:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891b9914380 x1875174015347584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788305856.470953:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788305856.470956:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788305856.470958:0:36:0:(import.c:65:import_set_state_nolock()) ffff889082119000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788305856.470962:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 681 00000100:00080000:2.0:1788305856.470964:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788305856.470967:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff889082119000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305856.470977:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891b9915180 x1875174015347840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788305856.471007:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305856.471035:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015347712:0@lo:400:kworker.0 00000400:00000100:2.0:1788305856.471081:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875174015347712 offset 0 length 224: 4 00000100:00100000:2.0:1788305856.471132:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015347968:0@lo:400:kworker.0 00000400:00000100:2.0:1788305856.471148:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875174015347968 offset 0 length 224: 4 00000100:00100000:0.0:1788305856.471214:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875174015347584:0@lo:38:kworker.0 00000400:00000100:0.0:1788305856.471237:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875174015347584 offset 0 length 520: 4 00000100:00100000:0.0:1788305856.471250:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875174015347840:0@lo:38:kworker.0 00000400:00000100:0.0:1788305856.471263:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875174015347840 offset 0 length 520: 4 00000020:01000004:1.0:1788305856.593237:0:21133:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1788305856.609406:0:21133:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788305856.609469:0:21133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51000/0x4a426866e605484c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054853 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305856.609485:0:21133:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51000/0x4a426866e605484c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054853 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305856.609493:0:21133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51000/0x4a426866e605484c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6054853 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305856.609499:0:21133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff889083c51000/0x4a426866e605484c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6054853 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305856.609516:0:21133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788305856.609521:0:21133:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788305856.609544:0:21133:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788305856.609554:0:21133:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8891b9914380 x1875174015347584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788305881 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305856.609570:0:21133:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788305856.609575:0:21133:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788305856.609580:0:21133:0:(import.c:65:import_set_state_nolock()) ffff889082340000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788305856.609584:0:21133:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788305856.609587:0:21133:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8891b9914380 x1875174015347584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788305881 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305856.609611:0:21133:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788305856.609614:0:21133:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 33s for inflight to error out 00000100:00100000:0.0:1788305856.609903:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875174015347584:0@lo:38:kworker.0 00000100:00080000:1.0:1788305856.610876:0:21133:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788305856.610886:0:21133:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8891b9915500 x1875174015347712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305872 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305856.610898:0:21133:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788305856.610902:0:21133:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788305856.610924:0:21133:0:(import.c:65:import_set_state_nolock()) ffff88919402f800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788305856.611087:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015347712:0@lo:400:kworker.0 00000100:00100000:0.0:1788305856.611263:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875174015348096:0@lo:39:umount.0 00000400:00000100:0.0:1788305856.611350:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875174015348096 offset 0 length 224: 4 00010000:00010000:3.0:1788305856.611876:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305856.611884:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889083c51000/0x4a426866e605484c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6054853 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305856.611906:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51000 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:3.0:1788305856.611910:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889083c51000/0x4a426866e605484c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6054853 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305856.611919:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889083c51000/0x4a426866e605484c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e6054853 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305856.611926:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889083c51000/0x4a426866e605484c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e6054853 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305856.611932:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788305856.611934:0:17141:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788305856.611937:0:17141:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788305856.611951:0:17141:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889083f77000 00010000:00010000:3.0:1788305856.611954:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889083c51000/0x4a426866e605484c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e6054853 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305856.611961:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889083c51000/0x4a426866e605484c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e6054853 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305856.611972:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305856.611974:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305856.611976:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305857.109490:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788305858.011406:0:18655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788305858.011416:0:18655:0:(genops.c:885:class_export_put()) final put ffff88918665b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788305858.011552:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88918665b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788305858.011602:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891834d4000 for lustre-OST0000 00000001:00100000:3.0:1788305858.013197:0:19473:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788305858.013205:0:19473:0:(genops.c:885:class_export_put()) final put ffff8890821a8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788305858.013298:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8890821a8800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788305858.013357:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8890821ab800 for lustre-OST0001 00010000:00010000:3.0:1788305858.133546:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305859.157439:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305860.182022:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305861.205434:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788305861.591174:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 739dca1e-bd16-46de-8d05-a6337c8af843->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788305861.591185:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 739dca1e-bd16-46de-8d05-a6337c8af843->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788305861.591205:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788305861.591209:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788305861.591322:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305861.591344:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015348224:0@lo:400:kworker.0 00000400:00000100:1.0:1788305861.591398:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875174015348224 offset 0 length 224: 4 00000100:00100000:0.0:1788305861.726208:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305851/real 1788305851] req@ffff8891b9914e00 x1875174015347456/t0(0) o250->MGC192.168.202.155@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788305861 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305861.726239:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8891b9914e00 x1875174015347456/t0(0) o250->MGC192.168.202.155@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788305861 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788305861.726260:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889083f77000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305861.726311:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788305861.726315:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:739dca1e-bd16-46de-8d05-a6337c8af843:3646:1875174015347456:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1788305861.728132:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 739dca1e-bd16-46de-8d05-a6337c8af843->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788305861.728141:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788305861.728144:0:36:0:(import.c:65:import_set_state_nolock()) ffff889083f77000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788305861.728151:0:36:0:(import.c:510:import_select_connection()) MGC192.168.202.155@tcp: connect to NID 0@lo last attempt 682 00000100:00080000:3.0:1788305861.728157:0:36:0:(import.c:589:import_select_connection()) MGC192.168.202.155@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788305861.728164:0:36:0:(import.c:624:import_select_connection()) MGC192.168.202.155@tcp: import ffff889083f77000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305861.728200:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889188561180 x1875174015348352/t0(0) o250->MGC192.168.202.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788305861.728232:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788305861.728236:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788305861.728322:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:739dca1e-bd16-46de-8d05-a6337c8af843:3646:1875174015348352:0@lo:250:kworker.0 00000400:00000100:0.0:1788305861.728374:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875174015348352 offset 0 length 520: 4 00010000:00010000:3.0:1788305862.230242:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305863.253434:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305864.280352:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305865.302387:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305866.327724:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305866.837428:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305856/real 1788305856] req@ffff8891bb23e680 x1875174015348096/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788305866 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305866.837461:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8891bb23e680 x1875174015348096/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788305866 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788305866.837481:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88919402f800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788305866.837504:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875174015348096:0@lo:39:umount.0 00000100:00080000:1.0:1788305866.837661:0:21133:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788305866.837668:0:21133:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788305866.837672:0:21133:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788305866.838818:0:21133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083f21e00/0x4a426866e6054822 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054829 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305866.838833:0:21133:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083f21e00/0x4a426866e6054822 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054829 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305866.838839:0:21133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083f21e00/0x4a426866e6054822 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6054829 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305866.838864:0:21133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff889083f21e00/0x4a426866e6054822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6054829 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305866.838891:0:21133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305866.838899:0:21133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054b86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054b8d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305866.838906:0:21133:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054b86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054b8d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305866.838913:0:21133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054b86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6054b8d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305866.838918:0:21133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054b86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6054b8d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305866.839000:0:21133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788305866.839006:0:21133:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788305866.839035:0:21133:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788305866.839040:0:21133:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788305866.839044:0:21133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305866.839049:0:21133:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788305866.839053:0:21133:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8891b91799b8) has no exports 00000020:00080000:1.0:1788305866.839076:0:21133:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8891b91799b8) has no exports 00010000:00010000:3.0:1788305866.854246:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788305866.854261:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889083f21e00/0x4a426866e6054822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6054829 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305866.854272:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f21e00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:3.0:1788305866.854290:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889083f21e00/0x4a426866e6054822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6054829 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305866.854310:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889083f21e00/0x4a426866e6054822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e6054829 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305866.854317:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889083f21e00/0x4a426866e6054822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e6054829 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305866.854344:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788305866.854347:0:17141:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788305866.854351:0:17141:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788305866.854368:0:17141:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889083f77000 00010000:00010000:3.0:1788305866.854372:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889083f21e00/0x4a426866e6054822 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e6054829 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305866.854378:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889083f21e00/0x4a426866e6054822 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e6054829 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305866.854392:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305866.854396:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054b86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6054b8d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305866.854401:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9400 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:3.0:1788305866.854418:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054b86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6054b8d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305866.854425:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054b86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e6054b8d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305866.854430:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054b86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e6054b8d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305866.854434:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788305866.854436:0:17141:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788305866.854438:0:17141:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788305866.854443:0:17141:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889083f77000 00010000:00010000:3.0:1788305866.854445:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054b86 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e6054b8d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305866.854457:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054b86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e6054b8d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305866.854465:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305866.854467:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305866.854469:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788305866.855268:0:21133:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff889081088480 - data ffff88918afe60d8/ffff8891be1e0c00 00000020:01000000:1.0:1788305866.855668:0:21133:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8891885720c0 - data ffff889081c691b0/ffff8891bbaff000 00010000:00010000:0.0:1788305866.864936:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788305866.877657:0:21133:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788305866.890002:0:21133:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054837 00000020:00000080:0.0:1788305866.890017:0:21133:0:(genops.c:885:class_export_put()) final put ffff889082345800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788305866.890037:0:21133:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8891894cf800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788305866.890041:0:21133:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8891894cf800 2 00000020:01000004:0.0:1788305866.890044:0:21133:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8891894cf800 from lustre-OST0000 00000020:00000080:0.0:1788305866.890076:0:21133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788305866.890086:0:21133:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788305866.890089:0:21133:0:(genops.c:885:class_export_put()) final put ffff889082343800/lustre-OST0000_UUID 00000020:00000080:0.0:1788305866.890092:0:21133:0:(genops.c:844:class_export_destroy()) destroying export ffff889082343800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788305866.890106:0:21133:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788305866.890179:0:21133:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788305866.890185:0:21133:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788305866.890188:0:21133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788305866.890193:0:21133:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788305866.890199:0:21133:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff88918448c800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788305866.890204:0:21133:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff8891b917cd28) has exports, disconnecting them 00000020:00080000:0.0:1788305866.890208:0:21133:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff88918448c800), last request at 1788305757 00000020:00000080:0.0:1788305866.890212:0:21133:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054861 00000020:00080000:0.0:1788305866.890223:0:21133:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88918448c800): rc 0 00000020:00000080:0.0:1788305866.890228:0:21133:0:(genops.c:885:class_export_put()) final put ffff88918448c800/lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788305866.891575:0:21133:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788305866.891592:0:21133:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788305866.891596:0:21133:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788305866.891603:0:21133:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788305866.891780:0:21133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305866.891788:0:21133:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1788305866.891806:0:21133:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788305866.891810:0:21133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305866.891814:0:21133:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788305866.891821:0:21133:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff88918448c000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788305866.891827:0:21133:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff8891bdc419b8) has exports, disconnecting them 00000020:00080000:1.0:1788305866.891831:0:21133:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff88918448c000), last request at 1788305757 00000020:00000080:1.0:1788305866.891836:0:21133:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054876 00000020:00080000:1.0:1788305866.891851:0:21133:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88918448c000): rc 0 00000020:00000080:1.0:1788305866.891855:0:21133:0:(genops.c:885:class_export_put()) final put ffff88918448c000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788305866.892787:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889082345800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788305866.892798:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88918448c800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788305866.892803:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889082340000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788305866.892809:0:36:0:(genops.c:885:class_export_put()) final put ffff889082347000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788305866.892811:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889082347000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788305866.892816:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788305866.892877:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88918448c000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788305866.906345:0:21133:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788305866.906353:0:21133:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788305866.906358:0:21133:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788305866.906366:0:21133:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788305866.906398:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88919402f800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788305866.906589:0:21133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788305866.906597:0:21133:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788305866.906602:0:21133:0:(genops.c:885:class_export_put()) final put ffff88918448f800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788305866.906606:0:21133:0:(genops.c:844:class_export_destroy()) destroying export ffff88918448f800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788305866.906618:0:21133:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788305866.906683:0:21133:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8891894cf800 1 00000020:00000080:3.0:1788305866.906689:0:21133:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054814 00000020:00000080:3.0:1788305866.906696:0:21133:0:(genops.c:885:class_export_put()) final put ffff8891b99ca000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788305866.906704:0:21133:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788305866.906721:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8891b99ca000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788305866.906731:0:21133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788305866.906736:0:21133:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788305866.906740:0:21133:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff88918402b370) has no exports 00000020:00000080:3.0:1788305866.936771:0:21133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788305866.936787:0:21133:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788305866.936921:0:21133:0:(genops.c:885:class_export_put()) final put ffff8891834d7000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788305866.936927:0:21133:0:(genops.c:844:class_export_destroy()) destroying export ffff8891834d7000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788305866.936939:0:21133:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788305866.937060:0:21133:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8891894ce800 00000020:02000400:3.0:1788305866.937108:0:21133:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:3.0:1788305867.223642:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 739dca1e-bd16-46de-8d05-a6337c8af843->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788305867.223650:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 739dca1e-bd16-46de-8d05-a6337c8af843->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788305867.223652:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788305867.223655:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788305867.223809:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015348480:0@lo:400:kworker.0 00000400:00000100:3.0:1788305867.223874:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875174015348480 offset 0 length 224: 4 00010000:00010000:0.0:1788305867.368427:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305868.379671:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305869.405099:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305870.429110:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305871.445722:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788305871.648170:0:21336:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1788305871.681262:0:21336:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788305871.681376:0:21336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183565400/0x4a426866e60549aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60549b1 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305871.681391:0:21336:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183565400/0x4a426866e60549aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60549b1 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305871.681397:0:21336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183565400/0x4a426866e60549aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60549b1 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305871.681404:0:21336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff889183565400/0x4a426866e60549aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60549b1 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305871.681430:0:21336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788305871.681447:0:21336:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788305871.681479:0:21336:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788305871.681490:0:21336:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8891b9915180 x1875174015347840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788305881 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305871.681505:0:21336:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788305871.681533:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889082119000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305871.681546:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:1.0:1788305871.681550:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875174015347840:0@lo:38:kworker.0 00000100:00080000:1.0:1788305871.681574:0:21336:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788305871.681578:0:21336:0:(import.c:65:import_set_state_nolock()) ffff889082119000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788305871.681582:0:21336:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788305871.681584:0:21336:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788305871.681586:0:21336:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788305871.682132:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305871.682141:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889183565400/0x4a426866e60549aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60549b1 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305871.682149:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183565400 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:0.0:1788305871.682152:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889183565400/0x4a426866e60549aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60549b1 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305871.682161:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889183565400/0x4a426866e60549aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e60549b1 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305871.682178:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889183565400/0x4a426866e60549aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e60549b1 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305871.682184:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788305871.682186:0:17140:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788305871.682189:0:17140:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788305871.682204:0:17140:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889083f77000 00010000:00010000:0.0:1788305871.682207:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889183565400/0x4a426866e60549aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e60549b1 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305871.682213:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889183565400/0x4a426866e60549aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e60549b1 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305871.682223:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305871.682225:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305871.682227:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788305871.682237:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 739dca1e-bd16-46de-8d05-a6337c8af843->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788305871.682241:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 739dca1e-bd16-46de-8d05-a6337c8af843->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788305871.682309:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015348608:0@lo:400:kworker.0 00000400:00000100:0.0:1788305871.682357:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875174015348608 offset 0 length 224: 4 00000100:00080000:1.0:1788305871.682925:0:21336:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788305871.682935:0:21336:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8891b9916a00 x1875174015347968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305872 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305871.682955:0:21336:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889188561500 x1875174015348224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305877 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305871.682964:0:21336:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889188560700 x1875174015348480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305883 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305871.682973:0:21336:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8891afb34e00 x1875174015348608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305887 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305871.682981:0:21336:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788305871.682986:0:21336:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788305871.682998:0:21336:0:(import.c:65:import_set_state_nolock()) ffff889082341000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788305871.683021:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875174015348736:0@lo:39:umount.0 00000100:00100000:0.0:1788305871.683165:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015348480:0@lo:400:kworker.0 00000100:00100000:0.0:1788305871.683190:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015348608:0@lo:400:kworker.0 00000400:00000100:1.0:1788305871.683268:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875174015348736 offset 0 length 224: 4 00000100:00100000:2.0:1788305871.685239:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015348224:0@lo:400:kworker.0 00000100:00100000:2.0:1788305871.685252:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015347968:0@lo:400:kworker.0 00010000:00010000:3.0:1788305872.470214:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305873.493812:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305874.517487:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305875.541781:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305876.565551:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305876.821437:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305861/real 1788305861] req@ffff889188561180 x1875174015348352/t0(0) o250->MGC192.168.202.155@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788305876 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305876.821469:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889188561180 x1875174015348352/t0(0) o250->MGC192.168.202.155@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788305876 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788305876.821488:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889083f77000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305876.821583:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788305876.821588:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:739dca1e-bd16-46de-8d05-a6337c8af843:3646:1875174015348352:0@lo:250:kworker.0 00000100:00080000:2.0:1788305876.825800:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 739dca1e-bd16-46de-8d05-a6337c8af843->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788305876.825826:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788305876.825830:0:8:0:(import.c:65:import_set_state_nolock()) ffff889083f77000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788305876.825839:0:8:0:(import.c:510:import_select_connection()) MGC192.168.202.155@tcp: connect to NID 0@lo last attempt 691 00000100:00080000:2.0:1788305876.825845:0:8:0:(import.c:589:import_select_connection()) MGC192.168.202.155@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788305876.825852:0:8:0:(import.c:624:import_select_connection()) MGC192.168.202.155@tcp: import ffff889083f77000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305876.826850:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891b9916a00 x1875174015348864/t0(0) o250->MGC192.168.202.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788305876.827256:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:739dca1e-bd16-46de-8d05-a6337c8af843:3646:1875174015348864:0@lo:250:kworker.0 00000400:00000100:1.0:1788305876.827328:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875174015348864 offset 0 length 520: 4 00010000:00010000:0.0:1788305877.589637:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305878.613679:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305879.637445:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305880.661525:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305881.685498:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305881.941402:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305871/real 1788305871] req@ffff8891bb23d880 x1875174015348736/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788305881 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305881.941435:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8891bb23d880 x1875174015348736/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788305881 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788305881.941455:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889082341000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788305881.941531:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875174015348736:0@lo:39:umount.0 00000100:00080000:0.0:1788305881.943120:0:21336:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788305881.943126:0:21336:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788305881.943132:0:21336:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788305881.944105:0:21336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183564800/0x4a426866e6054980 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054987 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305881.944120:0:21336:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183564800/0x4a426866e6054980 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054987 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305881.944127:0:21336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183564800/0x4a426866e6054980 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6054987 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305881.944134:0:21336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff889183564800/0x4a426866e6054980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6054987 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305881.944584:0:21336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305881.944594:0:21336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51e00/0x4a426866e6054b78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054b7f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305881.944601:0:21336:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51e00/0x4a426866e6054b78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054b7f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305881.944606:0:21336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51e00/0x4a426866e6054b78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6054b7f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305881.944612:0:21336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff889083c51e00/0x4a426866e6054b78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6054b7f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305881.944749:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788305881.944757:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889183564800/0x4a426866e6054980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6054987 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305881.944772:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183564800 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:3.0:1788305881.944789:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889183564800/0x4a426866e6054980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6054987 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305881.944798:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889183564800/0x4a426866e6054980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e6054987 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305881.944805:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889183564800/0x4a426866e6054980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e6054987 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305881.944810:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788305881.944812:0:17141:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788305881.944823:0:17141:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889083f77000 00010000:00010000:3.0:1788305881.944827:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889183564800/0x4a426866e6054980 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e6054987 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305881.944834:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889183564800/0x4a426866e6054980 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e6054987 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305881.944849:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305881.944851:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889083c51e00/0x4a426866e6054b78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6054b7f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305881.944857:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51e00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:3.0:1788305881.944859:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889083c51e00/0x4a426866e6054b78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6054b7f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305881.944865:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889083c51e00/0x4a426866e6054b78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e6054b7f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305881.944871:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889083c51e00/0x4a426866e6054b78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e6054b7f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305881.944887:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788305881.944889:0:17141:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788305881.944894:0:17141:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889083f77000 00010000:00010000:3.0:1788305881.944897:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889083c51e00/0x4a426866e6054b78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e6054b7f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305881.944903:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305881.944905:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305881.944907:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305881.945059:0:21336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788305881.945070:0:21336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889083c51e00/0x4a426866e6054b78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e6054b7f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305881.945084:0:21336:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788305881.945090:0:21336:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1788305881.945092:0:21336:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788305881.945119:0:21336:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788305881.945123:0:21336:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788305881.945128:0:21336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788305881.945133:0:21336:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788305881.945137:0:21336:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8891b9178000) has no exports 00000020:00080000:0.0:1788305881.945160:0:21336:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8891b9178000) has no exports 00010000:00010000:2.0:1788305881.945249:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788305881.947600:0:21336:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88919e0b8de0 - data ffff88918afc3438/ffff8891bbb81000 00000020:01000000:0.0:1788305881.947846:0:21336:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff889188572660 - data ffff88919dd76798/ffff889084661800 00100000:10000000:0.0:1788305881.956657:0:21336:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788305881.969182:0:21336:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054995 00000020:00000080:2.0:1788305881.969193:0:21336:0:(genops.c:885:class_export_put()) final put ffff889082345000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788305881.969212:0:21336:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88908353f800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788305881.969215:0:21336:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88908353f800 2 00000020:01000004:2.0:1788305881.969218:0:21336:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88908353f800 from lustre-OST0001 00000020:00000080:2.0:1788305881.969243:0:21336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788305881.969251:0:21336:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788305881.969253:0:21336:0:(genops.c:885:class_export_put()) final put ffff889082342000/lustre-OST0001_UUID 00000020:00000080:2.0:1788305881.969255:0:21336:0:(genops.c:844:class_export_destroy()) destroying export ffff889082342000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788305881.969269:0:21336:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788305881.969373:0:21336:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 739dca1e-bd16-46de-8d05-a6337c8af843->MGS 00010000:00010000:2.0:1788305881.969397:0:21336:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891903f8c00/0x4a426866e60546e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e60546e7 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305881.969408:0:21336:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891903f8c00/0x4a426866e60546e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e60546e7 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305881.969413:0:21336:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788305881.969416:0:21336:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788305881.969419:0:21336:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788305881.969432:0:21336:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889083f77000 00010000:00010000:2.0:1788305881.969435:0:21336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891903f8c00/0x4a426866e60546e0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e60546e7 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305881.969448:0:21336:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e60545cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e60545d6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305881.969454:0:21336:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e60545cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e60545d6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305881.969458:0:21336:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788305881.969460:0:21336:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788305881.969462:0:21336:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788305881.969470:0:21336:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889083f77000 00010000:00010000:2.0:1788305881.969473:0:21336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e60545cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e60545d6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788305881.969487:0:21336:0:(import.c:65:import_set_state_nolock()) ffff889083f77000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788305881.969491:0:21336:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788305881.969493:0:21336:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788305881.969500:0:21336:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788305881.969504:0:21336:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788305881.969513:0:21336:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8891b9916a00 x1875174015348864/t0(0) o250->MGC192.168.202.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788305896 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788305881.969527:0:21336:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788305881.969529:0:21336:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1788305881.969570:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:739dca1e-bd16-46de-8d05-a6337c8af843:3646:1875174015348864:0@lo:250:kworker.0 10000000:01000000:2.0:1788305881.969597:0:21336:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788305881.969604:0:21336:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60545ba 00000020:00000080:2.0:1788305881.969608:0:21336:0:(genops.c:885:class_export_put()) final put ffff889083f77800/739dca1e-bd16-46de-8d05-a6337c8af843 00000020:01000000:2.0:1788305881.969613:0:21336:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.155@tcp (flags='') 00000020:00000080:2.0:1788305881.969630:0:21336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788305881.969635:0:21336:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.155@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788305881.969638:0:21336:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8891bb4f4d28) has no exports 10000000:01000000:2.0:1788305881.969652:0:17149:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788305881.969688:0:21336:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.155@tcp: client import never connected 00000100:00080000:2.0:1788305881.969690:0:21336:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788305881.969692:0:21336:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788305881.969694:0:21336:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788305881.969695:0:21336:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788305881.969764:0:21336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788305881.969769:0:21336:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.155@tcp (uuid 739dca1e-bd16-46de-8d05-a6337c8af843) 00000020:01000000:2.0:1788305881.969774:0:21336:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788305881.969777:0:21336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788305881.969780:0:21336:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788305881.969784:0:21336:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff88908211c800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788305881.969788:0:21336:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff8890835799b8) has exports, disconnecting them 00000020:00080000:2.0:1788305881.969792:0:21336:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff88908211c800), last request at 1788305774 00000020:00000080:2.0:1788305881.969796:0:21336:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60549bf 00000020:00080000:2.0:1788305881.969804:0:21336:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88908211c800): rc 0 00000020:00000080:2.0:1788305881.969807:0:21336:0:(genops.c:885:class_export_put()) final put ffff88908211c800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788305881.970215:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889082345000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788305881.970228:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889083f77800/739dca1e-bd16-46de-8d05-a6337c8af843 for MGC192.168.202.155@tcp 00000020:00000080:0.0:1788305881.970234:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889083f77000 for MGC192.168.202.155@tcp 00000020:00000080:0.0:1788305881.970240:0:36:0:(genops.c:885:class_export_put()) final put ffff889083f75000/739dca1e-bd16-46de-8d05-a6337c8af843 00000020:00000080:0.0:1788305881.970242:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889083f75000/739dca1e-bd16-46de-8d05-a6337c8af843 for MGC192.168.202.155@tcp 00000020:01000000:0.0:1788305881.970248:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.155@tcp (739dca1e-bd16-46de-8d05-a6337c8af843) 00000020:00000080:0.0:1788305881.970578:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88908211c800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788305881.978685:0:21336:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788305881.978692:0:21336:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788305881.978697:0:21336:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788305881.978704:0:21336:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788305881.978968:0:21336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788305881.978978:0:21336:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788305881.978983:0:21336:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788305881.978987:0:21336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788305881.978991:0:21336:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788305881.978998:0:21336:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff889082344800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788305881.979013:0:21336:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff88908357b370) has exports, disconnecting them 00000020:00080000:2.0:1788305881.979021:0:21336:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff889082344800), last request at 1788305774 00000020:00000080:2.0:1788305881.979025:0:21336:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60549d4 00000020:00080000:2.0:1788305881.979036:0:21336:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff889082344800): rc 0 00000020:00000080:2.0:1788305881.979041:0:21336:0:(genops.c:885:class_export_put()) final put ffff889082344800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788305881.979677:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889082119000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788305881.979685:0:36:0:(genops.c:885:class_export_put()) final put ffff889082118000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788305881.979687:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889082118000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788305881.979698:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788305881.980084:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889082344800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1788305881.985345:0:21336:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788305881.985354:0:21336:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788305881.985368:0:21336:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788305881.985449:0:21336:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788305881.985484:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889082341000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788305881.992028:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788305882.003364:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:1.0:1788305882.004542:0:17135:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8891a5035000:17135] 0 exiting: rc = 1 00000100:00100000:1.0:1788305882.004654:0:17136:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff88908310ca00:17136] 1 exiting: rc = 0 00000100:00100000:1.0:1788305882.004709:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.004963:0:17139:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8891b8eb1000:17139] 2 exiting: rc = 0 00000100:00100000:3.0:1788305882.006035:0:19490:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff889082115000:19490] 3 exiting: rc = 0 00000100:00100000:3.0:1788305882.006126:0:17138:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8891b8eb1200:17138] 1 exiting: rc = 0 00000100:00100000:1.0:1788305882.009958:0:17137:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff88908310d200:17137] 0 exiting: rc = 1 00000100:00100000:1.0:1788305882.010813:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010822:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010828:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010834:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010839:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010847:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010853:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010858:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010873:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010878:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010883:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010888:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010892:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010897:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010901:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010907:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010913:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010918:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010923:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010929:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010934:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010939:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010943:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010948:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010952:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010970:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010975:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010980:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010985:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010989:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010994:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.010998:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.012902:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.012925:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.012931:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.012935:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.012940:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.012945:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.012951:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.012955:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.012961:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.012966:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.012971:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.012976:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.012981:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.013707:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.013722:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.013728:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.013733:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.013738:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.013744:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.013750:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.013755:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.013759:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.013764:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.013769:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.013773:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.013778:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.013783:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.013787:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.013815:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.013820:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.013825:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.013830:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788305882.021639:0:21336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305882.021652:0:21336:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1788305882.021658:0:21336:0:(genops.c:885:class_export_put()) final put ffff88908211a800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1788305882.021662:0:21336:0:(genops.c:844:class_export_destroy()) destroying export ffff88908211a800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1788305882.021668:0:21336:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1788305882.021722:0:21336:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88908353f800 1 00000020:00000080:1.0:1788305882.021728:0:21336:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054979 00000020:00000080:1.0:1788305882.021734:0:21336:0:(genops.c:885:class_export_put()) final put ffff8891b998f800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788305882.021747:0:21336:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788305882.021757:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8891b998f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788305882.021768:0:21336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305882.021773:0:21336:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788305882.021776:0:21336:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff8891bdc43370) has no exports 00000020:00000080:1.0:1788305882.231415:0:21336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305882.231428:0:21336:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788305882.231433:0:21336:0:(genops.c:885:class_export_put()) final put ffff889083539800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788305882.231437:0:21336:0:(genops.c:844:class_export_destroy()) destroying export ffff889083539800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788305882.231447:0:21336:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788305882.232198:0:21336:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff88908353e000 00000020:01000000:1.0:1788305882.232220:0:21336:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788305882.232224:0:21336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305882.232229:0:21336:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788305882.232232:0:21336:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8891840299b8) has no exports 00000020:00000080:1.0:1788305882.232255:0:21336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305882.232261:0:21336:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788305882.232264:0:21336:0:(genops.c:885:class_export_put()) final put ffff8891b99cd800/OSS_uuid 00000020:00000080:1.0:1788305882.232267:0:21336:0:(genops.c:844:class_export_destroy()) destroying export ffff8891b99cd800/OSS_uuid for OSS 00000020:01000000:1.0:1788305882.232271:0:21336:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788305882.232482:0:18660:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8891b9810a00:18660] 1 exiting: rc = 0 00000100:00100000:1.0:1788305882.232587:0:18658:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8891be28ac00:18658] 0 exiting: rc = 1 00000100:00100000:1.0:1788305882.232649:0:18661:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8891be28c600:18661] 2 exiting: rc = 0 00000100:00100000:1.0:1788305882.232700:0:18928:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8891bbb49600:18928] 3 exiting: rc = 0 00000100:00100000:3.0:1788305882.232807:0:20293:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8891afb23c00:20293] 4 exiting: rc = 0 00000100:00100000:1.0:1788305882.232998:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233007:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233014:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233019:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233026:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233031:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233036:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233041:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233045:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233050:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233056:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233061:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233066:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233071:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233076:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233081:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233086:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233091:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233095:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233100:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233105:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233110:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233115:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233120:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233124:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233129:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233134:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233139:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233145:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233150:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233165:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233171:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233176:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233181:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233186:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233192:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233197:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233202:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233208:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233214:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233219:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233224:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233228:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233234:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233238:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233243:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233249:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233254:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233260:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233266:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233271:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233800:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233808:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233813:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233817:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233822:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233827:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233831:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233836:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233840:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233845:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233850:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233856:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.233861:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:2.0:1788305882.235096:0:17148:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788305882.235825:0:18663:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8891be28cc00:18663] 1 exiting: rc = 0 00000100:00100000:1.0:1788305882.236017:0:18662:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8891be28f600:18662] 0 exiting: rc = 1 00000100:00100000:2.0:1788305882.239497:0:20294:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8891bbbfb600:20294] 2 exiting: rc = 0 00000100:00100000:3.0:1788305882.249210:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249219:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249225:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249230:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249236:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249242:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249247:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249252:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249258:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249263:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249268:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249413:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249421:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249426:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249431:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249435:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249440:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249463:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249469:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249474:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249479:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249484:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249489:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249494:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249499:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249504:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249509:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249515:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249519:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249524:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249530:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249535:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249540:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249545:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249550:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.249555:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250135:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250144:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250150:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250154:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250159:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250164:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250170:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250175:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250179:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250184:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250188:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250193:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250199:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250204:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250208:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250213:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250228:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250233:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250238:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250243:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250248:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250254:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250259:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250264:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.250270:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.251250:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.251260:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305882.251265:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.255519:0:18666:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8891a7c35600:18666] 2 exiting: rc = 0 00000100:00100000:1.0:1788305882.255834:0:18665:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff889192eebc00:18665] 1 exiting: rc = 0 00000100:00100000:3.0:1788305882.256379:0:18664:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8891be28d000:18664] 0 exiting: rc = 1 00000100:00100000:2.0:1788305882.258372:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258380:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258389:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258394:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258399:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258404:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258409:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258414:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258421:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258427:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258432:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258438:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258461:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258468:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258473:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258478:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258499:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258506:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258512:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258517:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258522:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258528:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258533:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258539:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258545:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258550:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258556:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258684:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258690:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258695:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258701:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258711:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258717:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258722:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258727:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258733:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258739:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258745:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258751:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258757:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258779:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258786:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258791:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258796:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258801:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258807:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258813:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258828:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258833:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258838:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258844:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258849:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258854:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258859:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258865:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258871:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258876:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258894:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258901:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258912:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258918:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258923:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258928:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.258933:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.281727:0:18667:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8891a7c35e00:18667] 0 exiting: rc = 1 00000100:00100000:3.0:1788305882.281897:0:18668:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8891a7c35c00:18668] 1 exiting: rc = 0 00000100:00100000:2.0:1788305882.282040:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282049:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282054:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282059:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282065:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282070:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282075:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282080:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282084:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282089:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282094:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282099:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282104:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282109:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282114:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282119:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282124:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282129:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282146:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282150:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282156:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282162:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282167:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282172:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282178:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282183:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282188:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282193:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282198:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282203:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282209:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282215:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282219:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282224:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282230:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282235:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282240:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282245:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282251:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282257:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282262:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282267:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282315:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282324:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282330:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282336:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282341:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282346:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282352:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282357:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282363:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282377:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282384:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282395:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282401:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282406:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282412:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282418:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282423:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282428:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282434:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282439:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282445:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.282453:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305882.283667:0:18669:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8891a7c30000:18669] 0 exiting: rc = 1 00000100:00100000:3.0:1788305882.283897:0:18670:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8891a7c31e00:18670] 1 exiting: rc = 0 00000100:00100000:2.0:1788305882.284168:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.284175:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.284186:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.284208:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.284214:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.284219:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.284224:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.284229:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.284233:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.284239:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.284244:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.284249:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.284254:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.284259:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.284265:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285168:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285180:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285185:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285191:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285197:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285203:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285210:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285216:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285221:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285239:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285245:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285251:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285270:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285301:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285308:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285313:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285319:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285324:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285330:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285336:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285341:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285347:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285354:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285361:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285382:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285389:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285394:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285400:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285406:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285412:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285418:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285425:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285432:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285441:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285448:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285455:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285480:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285487:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285492:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285497:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285504:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285510:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285516:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285522:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285537:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285545:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.285555:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.290721:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305882.290747:0:21336:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788305882.321430:0:21336:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788305905.583528:0:22101:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788305917.421249:0:22701:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788305917.421256:0:22701:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788305917.421258:0:22701:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788305917.421433:0:22701:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8891bbb3a800 00000020:01000004:0.0:1788305917.421448:0:22701:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788305917.421455:0:22701:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788305917.421469:0:22701:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff88918402cd28) 00000020:00000080:0.0:1788305917.421481:0:22701:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788305917.558758:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788305917.569566:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788305917.574891:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788305917.575464:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788305917.575697:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788305917.575934:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788305917.576241:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788305917.576491:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788305917.576681:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788305917.576939:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788305917.577463:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788305917.577685:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788305917.578886:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788305917.579905:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788305917.581534:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788305917.582448:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788305917.582856:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788305917.583955:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788305917.586267:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788305917.587415:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788305917.588923:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788305917.589713:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788305917.590432:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788305917.590749:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788305917.596445:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788305917.597520:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788305917.597904:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788305917.598887:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788305917.600186:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788305917.607268:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788305917.607808:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788305917.608180:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788305917.608443:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788305917.608755:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788305917.614609:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788305917.614947:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788305917.615203:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788305917.615869:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788305917.618973:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788305917.620040:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788305917.621348:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788305917.621627:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788305917.621867:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788305917.622168:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788305917.622681:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788305917.627750:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788305917.631712:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788305917.639550:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788305917.640211:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788305917.640762:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788305917.641334:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788305917.641633:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788305917.641853:0:22701:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:3.0:1788305917.642591:0:22701:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788305917.642793:0:22701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788305917.642801:0:22701:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788305917.642812:0:22701:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e6054ec0 00000020:01000004:3.0:1788305917.642819:0:22701:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788305917.642824:0:22701:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788305917.642829:0:22701:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8891bbb3a800 from MGS 00000020:01000004:3.0:1788305917.642832:0:22701:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788305917.642841:0:22701:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8891bdc419b8) 00000020:00000080:3.0:1788305917.642851:0:22701:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788305917.642907:0:22701:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8891bbb3a800 from MGS, refs=2 00080000:01000000:3.0:1788305917.642911:0:22701:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788305917.642915:0:22701:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e6054ece 00000100:00100000:3.0:1788305917.643005:0:22701:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788305917.643214:0:22701:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788305917.643221:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788305917.645432:0:22701:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788305917.645445:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788305917.652814:0:22701:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788305917.653645:0:22701:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788305917.653652:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788305917.655500:0:22701:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788305917.655513:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788305917.655800:0:22701:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788305917.655807:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788305917.656433:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305917.656437:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305917.656439:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305917.656733:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305917.656735:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305917.656737:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305917.657636:0:22701:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788305917.662016:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788305917.663243:0:22701:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788305917.668070:0:22713:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788305917.668237:0:22701:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788305917.668335:0:22701:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788305917.669018:0:22701:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788305917.669380:0:22701:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788305917.669538:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788305917.669544:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788305917.670308:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788305917.670316:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788305917.671362:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788305917.671374:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788305917.672074:0:22701:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788305917.672365:0:22701:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.155@tcp' 00000020:01000004:0.0:1788305917.672367:0:22701:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788305917.672400:0:22701:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.155@tcp (typ=mgc) 00000020:00000080:0.0:1788305917.672414:0:22701:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.155@tcp (ffff889184028000) 00000020:00000080:0.0:1788305917.672428:0:22701:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788305917.672514:0:22701:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8891bbb3c000@MGC192.168.202.155@tcp: add connection 192.168.202.155@tcp at head 00010000:00010000:0.0:1788305917.672664:0:22701:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.155@tcp-0 is initialized 00000040:01000000:0.0:1788305917.672670:0:22701:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.155@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788305917.680455:0:22717:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788305917.681067:0:22720:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788305917.683169:0:22701:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.155@tcp (uuid f4402ecd-e8a2-4271-82d7-771a7bb97982) 00000020:00000080:2.0:1788305917.683209:0:22701:0:(genops.c:1385:class_connect()) connect: client f4402ecd-e8a2-4271-82d7-771a7bb97982, cookie 0x4a426866e6054edc 00000100:00080000:2.0:1788305917.683221:0:22701:0:(import.c:510:import_select_connection()) MGC192.168.202.155@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788305917.683227:0:22701:0:(import.c:624:import_select_connection()) MGC192.168.202.155@tcp: import ffff8891bbb3c000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305917.683261:0:22701:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891b9916a00 x1875174015348992/t0(0) o250->MGC192.168.202.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788305917.683311:0:22701:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f4402ecd-e8a2-4271-82d7-771a7bb97982->MGS 00000020:01000004:2.0:1788305917.683334:0:22701:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788305917.683359:0:22701:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788305917.683373:0:22701:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff889083578000) 00000020:00000080:2.0:1788305917.683386:0:22701:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788305917.685247:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f4402ecd-e8a2-4271-82d7-771a7bb97982:3646:1875174015348992:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788305917.685340:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305917.685911:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015348992 00000100:00100000:0.0:1788305917.685919:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015348992 00000100:00100000:0.0:1788305917.685956:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305917.685963:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbaab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3646:x1875174015348992:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788305917.685989:0:22714:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f4402ecd-e8a2-4271-82d7-771a7bb97982@0@lo t0 exp 0000000000000000 cur 747 last 0 00000020:00000080:0.0:1788305917.686015:0:22714:0:(genops.c:1385:class_connect()) connect: client f4402ecd-e8a2-4271-82d7-771a7bb97982, cookie 0x4a426866e6054eea 00000100:00080000:0.0:1788305917.686317:0:22714:0:(import.c:65:import_set_state_nolock()) ffff8891a4473800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305917.686384:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbaab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+5:3646:x1875174015348992:12345-0@lo:250:mount.lustre.0 Request processed in 419us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305917.686391:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305917.686440:0:3646:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.155@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788305917.686449:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.155@tcp: connect to target with instance 0 00000100:00080000:0.0:1788305917.686466:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.155@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788305917.686470:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788305917.686474:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bbb3c000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788305917.686476:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788305917.686485:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788305917.686490:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f4402ecd-e8a2-4271-82d7-771a7bb97982:3646:1875174015348992:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788305917.705463:0:22701:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305917.705676:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788305917.705683:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788305917.708716:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788305917.708730:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788305917.709265:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788305917.709272:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788305917.710005:0:22701:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305917.710398:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788305917.710405:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788305917.719048:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788305917.719065:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788305917.771265:0:22701:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788305917.771504:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788305917.771510:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788305917.773144:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788305917.773158:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788305917.774650:0:22701:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788305917.774875:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788305917.774881:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788305917.777158:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788305917.777170:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788305917.779373:0:22701:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788305917.779526:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788305917.779531:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788305917.781141:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788305917.781153:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788305917.781914:0:22701:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788305917.782085:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788305917.782103:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788305917.782873:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788305917.782880:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788305917.802031:0:22701:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305917.802251:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788305917.802256:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788305917.804108:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788305917.804120:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788305917.806763:0:22701:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788305917.806786:0:22701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788305917.814245:0:22701:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788305917.814410:0:22701:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788305917.814418:0:22701:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.155@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788305917.814547:0:22701:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.155@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788305917.814598:0:22701:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.155@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788305917.814603:0:22701:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788305917.814605:0:22701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788305917.814607:0:22701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305917.814608:0:22701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305917.814609:0:22701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305917.814611:0:22701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305917.814612:0:22701:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788305917.814614:0:22701:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788305917.814616:0:22701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305917.814617:0:22701:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788305917.814621:0:22701:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788305917.814623:0:22701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788305917.814624:0:22701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788305917.814625:0:22701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305917.814626:0:22701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305917.814627:0:22701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305917.814628:0:22701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305917.814629:0:22701:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788305917.814630:0:22701:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788305917.814631:0:22701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305917.814632:0:22701:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788305917.814658:0:22701:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788305917.814680:0:22701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9915500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015349120:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788305917.814760:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305917.814812:0:22701:0:(client.c:2715:ptlrpc_set_wait()) set ffff889188508a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788305917.815102:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015349120 00000100:00100000:3.0:1788305917.815111:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015349120 00000100:00100000:3.0:1788305917.815161:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305917.815171:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889190efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+5:22701:x1875174015349120:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788305917.815222:0:22716:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788305917.815225:0:22716:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788305917.815228:0:22716:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788305917.815887:0:22737:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788305917.818720:0:22716:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1788305917.820940:0:22738:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788305917.820947:0:22738:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788305917.820950:0:22738:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788305917.820953:0:22738:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788305917.821154:0:22738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1788305917.821388:0:22716:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788305917.821398:0:22716:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788305917.826128:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889190efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+5:22701:x1875174015349120:12345-0@lo:253:mount.lustre.0 Request processed in 10945us (11354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305917.826149:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305917.828861:0:22701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9915500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015349120:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788305917.828883:0:22701:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788305917.828901:0:22701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788305917.828903:0:22701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788305917.828904:0:22701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788305917.828905:0:22701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788305917.828907:0:22701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788305917.828909:0:22701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788305917.828910:0:22701:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788305917.828912:0:22701:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788305917.828913:0:22701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788305917.828915:0:22701:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788305917.831469:0:22701:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8891bbb3a800 from lustre-MDT0000 10000000:01000000:2.0:1788305917.831542:0:22701:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788305917.831546:0:22701:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788305917.831551:0:22701:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff889184028000 10000000:01000000:2.0:1788305917.831556:0:22701:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788305917.831565:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff889184028000 from 1 10000000:01000000:2.0:1788305917.831568:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788305917.831616:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054ef1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305917.831629:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054ef1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305917.831640:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054ef1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305917.831664:0:22701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015349248:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788305917.831734:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305917.831842:0:22701:0:(client.c:2715:ptlrpc_set_wait()) set ffff889186dc4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788305917.834083:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015349248 00000100:00100000:1.0:1788305917.834100:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015349248 00000100:00100000:1.0:1788305917.834324:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788305917.834338:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+5:22701:x1875174015349248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788305917.834361:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305917.834389:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889180031400/0x4a426866e6054ef8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6054ef1 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305917.834421:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889180031400/0x4a426866e6054ef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6054ef1 expref: 6 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305917.834432:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889180031400/0x4a426866e6054ef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6054ef1 expref: 6 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305917.835091:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889180031400, rc 0) 00000100:00100000:1.0:1788305917.835203:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+6:22701:x1875174015349248:12345-0@lo:101:mount.lustre.0 Request processed in 866us (3466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305917.835210:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788305917.835390:0:22701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015349248:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788305917.835411:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054ef1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054ef8 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305917.835426:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054ef1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054ef8 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305917.835518:0:22701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015349376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305917.835553:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305917.837711:0:22701:0:(client.c:2715:ptlrpc_set_wait()) set ffff889186dc4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788305917.838059:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015349376 00000100:00100000:0.0:1788305917.838068:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015349376 00000100:00100000:0.0:1788305917.838120:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788305917.838130:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+6:22701:x1875174015349376:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305917.838264:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+6:22701:x1875174015349376:12345-0@lo:501:mount.lustre.0 Request processed in 135us (2710us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788305917.838299:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788305917.839554:0:22701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015349376:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788305917.839600:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788305917.839626:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054ef1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054ef8 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305917.839637:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054ef1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054ef8 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305917.839652:0:22701:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8891bbb3a800 10000000:01000000:2.0:1788305917.839659:0:22701:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788305917.839664:0:22701:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8891bbb3a800 10000000:01000000:2.0:1788305917.839666:0:22701:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788305917.839670:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8891bbb3a800 from 1 10000000:01000000:2.0:1788305917.839674:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788305917.839703:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea400/0x4a426866e6054eff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305917.839711:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea400/0x4a426866e6054eff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305917.839721:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea400/0x4a426866e6054eff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305917.839740:0:22701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015349504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788305917.839812:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305917.839842:0:22701:0:(client.c:2715:ptlrpc_set_wait()) set ffff889186dc4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788305917.840084:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015349504 00000100:00100000:0.0:1788305917.840090:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015349504 00000100:00100000:0.0:1788305917.840121:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788305917.840130:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+6:22701:x1875174015349504:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305917.840141:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305917.840171:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891a523a600/0x4a426866e6054f06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6054eff expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305917.840205:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891a523a600/0x4a426866e6054f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6054eff expref: 7 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305917.840217:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891a523a600/0x4a426866e6054f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6054eff expref: 7 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305917.840226:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523a600, rc 0) 00000100:00100000:0.0:1788305917.840270:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+7:22701:x1875174015349504:12345-0@lo:101:mount.lustre.0 Request processed in 140us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305917.840306:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788305917.840467:0:22701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015349504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788305917.840480:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea400/0x4a426866e6054eff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054f06 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305917.840490:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea400/0x4a426866e6054eff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054f06 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305917.840502:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788305917.840512:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea400/0x4a426866e6054eff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054f06 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305917.840520:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea400/0x4a426866e6054eff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054f06 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305917.840527:0:22701:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788305917.840539:0:22701:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788305917.840544:0:22701:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8891bbb3a800 10000000:01000000:2.0:1788305917.840547:0:22701:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788305917.840550:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788305917.840553:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788305917.840570:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb600/0x4a426866e6054f0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305917.840589:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb600/0x4a426866e6054f0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305917.840596:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb600/0x4a426866e6054f0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305917.840619:0:22701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015349632:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788305917.840645:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305917.840663:0:22701:0:(client.c:2715:ptlrpc_set_wait()) set ffff889186dc4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788305917.842991:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015349632 00000100:00100000:0.0:1788305917.843005:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015349632 00000100:00100000:0.0:1788305917.843053:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788305917.843064:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+7:22701:x1875174015349632:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305917.843080:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305917.843098:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891a523b800/0x4a426866e6054f14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6054f0d expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305917.843126:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891a523b800/0x4a426866e6054f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6054f0d expref: 8 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305917.843136:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891a523b800/0x4a426866e6054f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6054f0d expref: 8 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305917.843145:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523b800, rc 0) 00000100:00100000:0.0:1788305917.843246:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+8:22701:x1875174015349632:12345-0@lo:101:mount.lustre.0 Request processed in 184us (2599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305917.843253:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788305917.843601:0:22701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015349632:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788305917.843619:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb600/0x4a426866e6054f0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054f14 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305917.843629:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb600/0x4a426866e6054f0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054f14 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305917.843696:0:22701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015349760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305917.843733:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305917.843845:0:22701:0:(client.c:2715:ptlrpc_set_wait()) set ffff889186dc4180 going to sleep for 11 seconds 00000100:00100000:3.0:1788305917.843906:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015349760 00000100:00100000:3.0:1788305917.843911:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015349760 00000100:00100000:3.0:1788305917.843952:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788305917.843959:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+8:22701:x1875174015349760:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305917.844095:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+9:22701:x1875174015349760:12345-0@lo:501:mount.lustre.0 Request processed in 137us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305917.844103:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788305917.844270:0:22701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015349760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305917.844329:0:22701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015349888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788305917.844373:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305917.844396:0:22701:0:(client.c:2715:ptlrpc_set_wait()) set ffff889186dc4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788305917.844570:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015349888 00000100:00100000:0.0:1788305917.844575:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015349888 00000100:00100000:0.0:1788305917.844598:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305917.844605:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+9:22701:x1875174015349888:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788305917.847634:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+9:22701:x1875174015349888:12345-0@lo:503:mount.lustre.0 Request processed in 3019us (3251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305917.847646:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788305917.847749:0:22701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015349888:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788305917.848584:0:22739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4402ecd-e8a2-4271-82d7-771a7bb97982:22739:1875174015350016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305917.848637:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305917.848707:0:22739:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af18ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788305917.848746:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015350016 00000100:00100000:2.0:1788305917.848753:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015350016 00000100:00100000:2.0:1788305917.848899:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788305917.848908:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+9:22739:x1875174015350016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305917.849731:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+9:22739:x1875174015350016:12345-0@lo:502:llog_process_th.0 Request processed in 822us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305917.849749:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788305917.849907:0:22739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4402ecd-e8a2-4271-82d7-771a7bb97982:22739:1875174015350016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788305917.849937:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305917.849949:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305917.849951:0:22739:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788305917.849957:0:22739:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788305917.849960:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788305917.849975:0:22739:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8890833d8000) 00000020:00000080:1.0:1788305917.849991:0:22739:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788305917.849996:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788305917.850095:0:22739:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788305917.850103:0:22739:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e6054f22 00000020:00000080:1.0:1788305917.850362:0:22739:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788305917.850367:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305917.850370:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305917.850372:0:22739:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788305917.850375:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305917.850378:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305917.850385:0:22739:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788305917.850389:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788305917.850397:0:22739:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8890833dcd28) 00000020:00000080:1.0:1788305917.850406:0:22739:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788305917.850410:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788305917.850413:0:22739:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788305917.850416:0:22739:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788305917.850421:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788305917.850471:0:22739:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8891bbb3a800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788305917.850483:0:22739:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8890833db370) 00000020:00000080:1.0:1788305917.850490:0:22739:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788305917.850543:0:22739:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788305917.850548:0:22739:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4a426866e6054f37 00000020:00000080:1.0:1788305917.850641:0:22739:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788305917.850647:0:22739:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788305917.850651:0:22739:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4a426866e6054f3e 00080000:01000000:1.0:1788305917.850655:0:22739:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788305917.850659:0:22739:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e6054f45 00010000:00010000:2.0:1788305917.939545:0:22739:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788305917.946806:0:22739:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934638 00000001:00080000:3.0:1788305917.947483:0:22739:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788305917.948384:0:22739:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8891bdc40000) 00000020:00000080:3.0:1788305917.948406:0:22739:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788305917.948501:0:22739:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788305917.948509:0:22739:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e6054f53 00000020:00000080:2.0:1788305917.951186:0:22739:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788305917.957142:0:22739:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4a426866e6054f5a 00000020:00000080:3.0:1788305917.958002:0:22739:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788305917.958014:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305917.958021:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305917.958023:0:22739:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788305917.958027:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788305917.958030:0:22739:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788305917.958031:0:22739:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788305917.958032:0:22739:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788305917.958034:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788305917.958037:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305917.958046:0:22739:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788305917.958050:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305917.958055:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305917.958056:0:22739:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788305917.958061:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788305917.958120:0:22739:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788305917.958142:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305917.958146:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305917.958147:0:22739:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788305917.958150:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305917.958153:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305917.958154:0:22739:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788305917.958156:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788305917.958162:0:22739:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.155@tcp to nid 0x20000c0a8ca9b (192.168.202.155@tcp) 00000020:00000080:3.0:1788305917.958188:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788305917.958204:0:22739:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8891bdc43370) 00000020:00000080:3.0:1788305917.958219:0:22739:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788305917.958225:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788305917.958307:0:22739:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788305917.958312:0:22739:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788305917.958321:0:22739:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e6054f68 00010000:00080000:3.0:1788305917.958353:0:22739:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8891bb1ea800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.155@tcp at head 00010000:00010000:1.0:1788305917.961603:0:22739:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788305917.962586:0:22739:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788305917.962601:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788305917.962633:0:22739:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788305917.962652:0:22739:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4a426866e6054f6f 00000100:00080000:3.0:1788305917.962663:0:22739:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788305917.962668:0:22739:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8891bb1ea800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305917.962702:0:22739:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889188563100 x1875174015350144/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788305917.962732:0:22739:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788305917.962796:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305917.962800:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305917.962801:0:22739:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788305917.962804:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788305917.962807:0:22739:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1788305917.962808:0:22739:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788305917.962810:0:22739:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788305917.962812:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788305917.962814:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305917.962816:0:22739:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788305917.962818:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788305917.962823:0:22739:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788305917.962827:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305917.962828:0:22739:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788305917.962831:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788305917.962836:0:22739:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.155@tcp to nid 0x20000c0a8ca9b (192.168.202.155@tcp) 00000020:01000000:3.0:1788305917.962860:0:22739:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788305917.962863:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788305917.962874:0:22739:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8891bdc44d28) 00000020:00000080:3.0:1788305917.962886:0:22739:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788305917.962890:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1788305917.962910:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4402ecd-e8a2-4271-82d7-771a7bb97982:3649:1875174015350272:0@lo:400:kworker.0 00000004:00080000:3.0:1788305917.962953:0:22739:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788305917.962959:0:22739:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788305917.962964:0:22739:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e6054f7d 00000100:00100000:2.0:1788305917.962974:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788305917.962991:0:22739:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8891bb1ed800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.155@tcp at head 00010000:00010000:3.0:1788305917.963188:0:22739:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1788305917.963589:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015350144:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788305917.963630:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305917.963681:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015350272 00000100:00100000:1.0:1788305917.963688:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015350272 00000100:00100000:1.0:1788305917.963733:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788305917.963743:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+9:3649:x1875174015350272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305917.963797:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+9:3649:x1875174015350272:12345-0@lo:400:kworker.0 Request processed in 55us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305917.963804:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788305917.963851:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4402ecd-e8a2-4271-82d7-771a7bb97982:3649:1875174015350272:0@lo:400:kworker.0 00000100:00100000:2.0:1788305917.963875:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015350144 00000100:00100000:2.0:1788305917.963880:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015350144 00000100:00100000:2.0:1788305917.963910:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788305917.963916:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875174015350144:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788305917.963930:0:22726:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:3.0:1788305917.964835:0:22739:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788305917.965143:0:22739:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788305917.970942:0:22739:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788305917.971350:0:22739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1788305917.974628:0:22739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1788305917.975229:0:22745:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788305917.975234:0:22745:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788305917.975895:0:22739:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788305917.975909:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788305917.975946:0:22739:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788305917.975971:0:22739:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4a426866e6054f84 00000100:00080000:3.0:1788305917.975983:0:22739:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788305917.975989:0:22739:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8891bb1ed800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305917.976027:0:22739:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889188563b80 x1875174015350400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788305917.976057:0:22739:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788305917.976155:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015350400:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788305917.976208:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305917.976212:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305917.976214:0:22739:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788305917.976218:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788305917.976220:0:22739:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1788305917.976222:0:22739:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000400:00000100:1.0:1788305917.976223:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875174015350400 offset 0 length 520: 4 00000020:01000000:3.0:1788305917.976224:0:22739:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788305917.976225:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788305917.976227:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305917.976228:0:22739:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788305917.976231:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788305917.976234:0:22739:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788305917.976237:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305917.976238:0:22739:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788305917.976240:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788305917.976244:0:22739:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.155@tcp to nid 0x20000c0a8ca9b (192.168.202.155@tcp) 00000020:01000000:3.0:1788305917.976264:0:22739:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788305917.976267:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788305917.976305:0:22739:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8891b9178000) 00000020:00000080:3.0:1788305917.976317:0:22739:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788305917.976323:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788305917.976390:0:22739:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788305917.976398:0:22739:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788305917.976404:0:22739:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e6054f92 00010000:00080000:3.0:1788305917.976437:0:22739:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88908353f000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.155@tcp at head 00010000:00010000:3.0:1788305917.976637:0:22739:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788305917.976709:0:22739:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788305917.976725:0:22739:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788305917.982521:0:22739:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305917.986777:0:22739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788305917.986998:0:22739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:0.0:1788305917.988386:0:22747:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788305917.988394:0:22747:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788305917.989325:0:22739:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788305917.989338:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788305917.989378:0:22739:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788305917.989399:0:22739:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4a426866e6054f99 00000100:00080000:3.0:1788305917.989413:0:22739:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788305917.989420:0:22739:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88908353f000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305917.989459:0:22739:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889188560a80 x1875174015350528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788305917.989484:0:22739:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788305917.989541:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305917.989545:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305917.989547:0:22739:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788305917.989551:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305917.989555:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305917.989557:0:22739:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788305917.989560:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788305917.989562:0:22739:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788305917.989565:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305917.989567:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305917.989568:0:22739:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788305917.989571:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305917.989573:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305917.989575:0:22739:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788305917.989578:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788305917.989608:0:22739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188562300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4402ecd-e8a2-4271-82d7-771a7bb97982:22739:1875174015350656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305917.989701:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305917.989740:0:22739:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788305917.989941:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015350528:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788305917.989980:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875174015350528 offset 0 length 520: 4 00000100:00100000:0.0:1788305917.990370:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015350656 00000100:00100000:0.0:1788305917.990378:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015350656 00000100:00100000:0.0:1788305917.990427:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788305917.990436:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+9:22739:x1875174015350656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305917.990574:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+9:22739:x1875174015350656:12345-0@lo:502:llog_process_th.0 Request processed in 138us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305917.990582:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788305917.991414:0:22739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188562300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4402ecd-e8a2-4271-82d7-771a7bb97982:22739:1875174015350656:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788305917.991451:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305917.991459:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305917.991461:0:22739:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788305917.991466:0:22739:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788305917.991690:0:22701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788305917.991712:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788305917.991735:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb600/0x4a426866e6054f0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054f14 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305917.991746:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb600/0x4a426866e6054f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054f14 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305917.991755:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8891bbb3a800 from 1 10000000:01000000:0.0:1788305917.991758:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788305917.991789:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523ba00/0x4a426866e6054fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305917.991805:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891a523ba00/0x4a426866e6054fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305917.991815:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891a523ba00/0x4a426866e6054fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305917.991834:0:22701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015350784:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788305917.991879:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305917.991898:0:22701:0:(client.c:2715:ptlrpc_set_wait()) set ffff889183959a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788305917.993233:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015350784 00000100:00100000:3.0:1788305917.993245:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015350784 00000100:00100000:3.0:1788305917.993337:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788305917.993348:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+9:22701:x1875174015350784:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305917.993367:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305917.993388:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181683600/0x4a426866e6054fa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6054fa0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305917.993415:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181683600/0x4a426866e6054fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6054fa0 expref: 10 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305917.993426:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181683600/0x4a426866e6054fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6054fa0 expref: 10 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305917.993435:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181683600, rc 0) 00000100:00100000:3.0:1788305917.993509:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+10:22701:x1875174015350784:12345-0@lo:101:mount.lustre.0 Request processed in 162us (1629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305917.993516:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788305917.993615:0:22701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015350784:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788305917.993633:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891a523ba00/0x4a426866e6054fa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054fa7 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305917.993643:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891a523ba00/0x4a426866e6054fa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054fa7 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305917.994185:0:22701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015350912:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788305917.994234:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305917.994316:0:22701:0:(client.c:2715:ptlrpc_set_wait()) set ffff889190e95cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305917.994365:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875174015350144:12345-0@lo:38:llog_process_th.0 Request processed in 30447us (30733us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788305917.994377:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788305917.994409:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bb1ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305917.994414:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788305917.994417:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015350144:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788305917.994891:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015350912 00000100:00100000:2.0:1788305917.994897:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015350912 00000100:00100000:2.0:1788305917.994927:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788305917.994934:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+10:22701:x1875174015350912:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788305917.994950:0:22714:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788305917.994955:0:22714:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788305917.995014:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+10:22701:x1875174015350912:12345-0@lo:256:mount.lustre.0 Request processed in 80us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305917.995020:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305917.997098:0:22701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015350912:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788305917.997743:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788305917.997770:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523ba00/0x4a426866e6054fa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054fa7 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305917.997782:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891a523ba00/0x4a426866e6054fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054fa7 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305917.997852:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8891bbb3a800 from 1 10000000:01000000:1.0:1788305917.997855:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788305917.997895:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889180030a00/0x4a426866e6054fae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305917.997904:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889180030a00/0x4a426866e6054fae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305917.997915:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889180030a00/0x4a426866e6054fae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305917.997936:0:22701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015351040:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788305917.998000:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305917.998036:0:22701:0:(client.c:2715:ptlrpc_set_wait()) set ffff889190e95cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305917.998126:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015351040 00000100:00100000:2.0:1788305917.998133:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015351040 00000100:00100000:2.0:1788305917.998172:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788305917.998180:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+10:22701:x1875174015351040:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788305917.998192:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305917.998206:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891bb3ebc00/0x4a426866e6054fb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6054fae expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305917.998235:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3ebc00/0x4a426866e6054fb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6054fae expref: 11 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305917.998244:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891bb3ebc00/0x4a426866e6054fb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6054fae expref: 11 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305917.998253:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ebc00, rc 0) 00000100:00100000:2.0:1788305917.998320:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+11:22701:x1875174015351040:12345-0@lo:101:mount.lustre.0 Request processed in 140us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305917.998327:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788305918.001546:0:22701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015351040:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788305918.001647:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889180030a00/0x4a426866e6054fae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054fb5 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305918.001660:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889180030a00/0x4a426866e6054fae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054fb5 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305918.001751:0:22701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015351168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305918.001810:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305918.001851:0:22701:0:(client.c:2715:ptlrpc_set_wait()) set ffff889190e95cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305918.002428:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015351168 00000100:00100000:2.0:1788305918.002436:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015351168 00000100:00100000:2.0:1788305918.002483:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788305918.002493:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+11:22701:x1875174015351168:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305918.002647:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+11:22701:x1875174015351168:12345-0@lo:501:mount.lustre.0 Request processed in 155us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305918.002656:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788305918.005937:0:22701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015351168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305918.006015:0:22701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015351296:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788305918.006093:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305918.006142:0:22701:0:(client.c:2715:ptlrpc_set_wait()) set ffff889190e95cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305918.006159:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015351296 00000100:00100000:0.0:1788305918.006166:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015351296 00000100:00100000:0.0:1788305918.006223:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788305918.006233:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+11:22701:x1875174015351296:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788305918.006411:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+11:22701:x1875174015351296:12345-0@lo:503:mount.lustre.0 Request processed in 179us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305918.006418:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788305918.006987:0:22701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015351296:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788305918.010384:0:22749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4402ecd-e8a2-4271-82d7-771a7bb97982:22749:1875174015351424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305918.010472:0:22749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305918.010514:0:22749:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb5259c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305918.010695:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015351424 00000100:00100000:3.0:1788305918.010703:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015351424 00000100:00100000:3.0:1788305918.010793:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788305918.010803:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+11:22749:x1875174015351424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305918.011900:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+11:22749:x1875174015351424:12345-0@lo:502:llog_process_th.0 Request processed in 1094us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305918.011911:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788305918.012086:0:22749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4402ecd-e8a2-4271-82d7-771a7bb97982:22749:1875174015351424:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788305918.012122:0:22749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305918.012132:0:22749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305918.012134:0:22749:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788305918.012145:0:22749:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8891bbb3a800 00000020:00000080:1.0:1788305918.012148:0:22749:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788305918.012157:0:22749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305918.012159:0:22749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305918.012161:0:22749:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788305918.012164:0:22749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305918.012166:0:22749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305918.012168:0:22749:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788305918.012171:0:22749:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8891bbb3a800 00000020:00000080:1.0:1788305918.012173:0:22749:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788305918.012238:0:22749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305918.012242:0:22749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305918.012244:0:22749:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788305918.012247:0:22749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305918.012249:0:22749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305918.012251:0:22749:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788305918.012254:0:22749:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8891bbb3a800 00000020:00000080:1.0:1788305918.012256:0:22749:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788305918.012272:0:22749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305918.012303:0:22749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305918.012313:0:22749:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788305918.012317:0:22749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305918.012320:0:22749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305918.012322:0:22749:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788305918.012325:0:22749:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8891bbb3a800 00000020:00000080:1.0:1788305918.012328:0:22749:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788305918.012372:0:22749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4402ecd-e8a2-4271-82d7-771a7bb97982:22749:1875174015351552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305918.012414:0:22749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305918.012454:0:22749:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb5259c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305918.012531:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015351552 00000100:00100000:0.0:1788305918.012537:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015351552 00000100:00100000:0.0:1788305918.012580:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788305918.012589:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+11:22749:x1875174015351552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305918.012691:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+11:22749:x1875174015351552:12345-0@lo:502:llog_process_th.0 Request processed in 103us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305918.012698:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788305918.012878:0:22749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4402ecd-e8a2-4271-82d7-771a7bb97982:22749:1875174015351552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788305918.012898:0:22749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305918.012903:0:22749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305918.012904:0:22749:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788305918.012908:0:22749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788305918.013083:0:22701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788305918.013113:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788305918.013127:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889180030a00/0x4a426866e6054fae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054fb5 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305918.013144:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889180030a00/0x4a426866e6054fae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054fb5 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305918.013199:0:22701:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788305918.013203:0:22701:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8891bbb3a800 10000000:01000000:0.0:1788305918.013206:0:22701:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8891bbb3a800 10000000:01000000:0.0:1788305918.013209:0:22701:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788305918.013215:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8891bbb3a800 from 1 10000000:01000000:0.0:1788305918.013217:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788305918.013242:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523a200/0x4a426866e6054fbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305918.013250:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891a523a200/0x4a426866e6054fbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305918.013258:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891a523a200/0x4a426866e6054fbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305918.013272:0:22701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb36680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015351680:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788305918.013356:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305918.013382:0:22701:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cc999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305918.013397:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015351680 00000100:00100000:0.0:1788305918.013400:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015351680 00000100:00100000:0.0:1788305918.013421:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788305918.013427:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+11:22701:x1875174015351680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305918.013435:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305918.013446:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891a523a400/0x4a426866e6054fc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6054fbc expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305918.013474:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891a523a400/0x4a426866e6054fc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6054fbc expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305918.013484:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891a523a400/0x4a426866e6054fc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6054fbc expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305918.013493:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523a400, rc 0) 00000100:00100000:0.0:1788305918.013524:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:22701:x1875174015351680:12345-0@lo:101:mount.lustre.0 Request processed in 97us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305918.013530:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788305918.013563:0:22701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb36680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015351680:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305918.013576:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891a523a200/0x4a426866e6054fbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054fc3 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305918.013585:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891a523a200/0x4a426866e6054fbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054fc3 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305918.013630:0:22701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb36680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015351808:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305918.013653:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305918.013666:0:22701:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891c0fbf540 going to sleep for 11 seconds 00000100:00100000:0.0:1788305918.013678:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015351808 00000100:00100000:0.0:1788305918.013681:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015351808 00000100:00100000:0.0:1788305918.013698:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788305918.013704:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:22701:x1875174015351808:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305918.013807:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:22701:x1875174015351808:12345-0@lo:501:mount.lustre.0 Request processed in 101us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305918.013822:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788305918.013854:0:22701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb36680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015351808:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305918.013878:0:22701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb36680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015351936:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788305918.013914:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305918.013927:0:22701:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891c0fbf540 going to sleep for 11 seconds 00000100:00100000:0.0:1788305918.013940:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015351936 00000100:00100000:0.0:1788305918.013943:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015351936 00000100:00100000:0.0:1788305918.013960:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788305918.013966:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:22701:x1875174015351936:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788305918.014034:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:22701:x1875174015351936:12345-0@lo:503:mount.lustre.0 Request processed in 67us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305918.014041:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788305918.014079:0:22701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb36680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015351936:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788305918.036085:0:22753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9914700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4402ecd-e8a2-4271-82d7-771a7bb97982:22753:1875174015352064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305918.036182:0:22753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305918.036230:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4deb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788305918.036380:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015352064 00000100:00100000:0.0:1788305918.036389:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015352064 00000100:00100000:0.0:1788305918.036440:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788305918.036451:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:22753:x1875174015352064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305918.036589:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:22753:x1875174015352064:12345-0@lo:502:llog_process_th.0 Request processed in 139us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305918.036597:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788305918.036908:0:22753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9914700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4402ecd-e8a2-4271-82d7-771a7bb97982:22753:1875174015352064:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788305918.036969:0:22753:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788305918.036984:0:22753:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff88908357cd28) 00000020:00000080:2.0:1788305918.037004:0:22753:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788305918.037093:0:22753:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8891bbb3a800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788305918.037098:0:22753:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8891bbb3a800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788305918.037114:0:22753:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8891bbb3a800 4 00010000:00080000:2.0:1788305918.037144:0:22753:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889083f75000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.155@tcp at head 00010000:00010000:2.0:1788305918.038738:0:22753:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788305918.038945:0:22753:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788305918.038982:0:22753:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788305918.038994:0:22753:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4a426866e6054fd1 00000100:00080000:2.0:1788305918.039004:0:22753:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788305918.039010:0:22753:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff889083f75000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305918.039042:0:22753:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891b9914700 x1875174015352192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788305918.039073:0:22753:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788305918.040845:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875174015352192:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788305918.040928:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305918.042802:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015352192 00000100:00100000:0.0:1788305918.042817:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015352192 00000100:00100000:0.0:1788305918.042881:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305918.042888:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875174015352192:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788305918.042983:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875174015352192:12345-0@lo:38:llog_process_th.0 Request processed in 93us (2054us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788305918.042990:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305918.043042:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788305918.043052:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889083f75000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305918.043057:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788305918.043061:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875174015352192:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788305918.051993:0:22753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4402ecd-e8a2-4271-82d7-771a7bb97982:22753:1875174015352320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305918.052078:0:22753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305918.052116:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015352320 00000100:00100000:2.0:1788305918.052123:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015352320 00000100:00100000:2.0:1788305918.052167:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788305918.052176:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:22753:x1875174015352320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305918.052328:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:22753:x1875174015352320:12345-0@lo:502:llog_process_th.0 Request processed in 152us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305918.052336:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788305918.052383:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4dec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305918.052405:0:22753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4402ecd-e8a2-4271-82d7-771a7bb97982:22753:1875174015352320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305918.052445:0:22753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4402ecd-e8a2-4271-82d7-771a7bb97982:22753:1875174015352448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305918.052478:0:22753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305918.052499:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015352448 00000100:00100000:2.0:1788305918.052503:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015352448 00000100:00100000:2.0:1788305918.052530:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788305918.052536:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:22753:x1875174015352448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305918.052594:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:22753:x1875174015352448:12345-0@lo:502:llog_process_th.0 Request processed in 57us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305918.052601:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788305918.052626:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918ab2c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788305918.052637:0:22753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4402ecd-e8a2-4271-82d7-771a7bb97982:22753:1875174015352448:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788305918.052654:0:22753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788305918.052833:0:22701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788305918.052861:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788305918.052886:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523a200/0x4a426866e6054fbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054fc3 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305918.052896:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891a523a200/0x4a426866e6054fbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054fc3 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788305918.052943:0:22701:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788305918.052946:0:22701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788305918.052947:0:22701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305918.052948:0:22701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305918.052950:0:22701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305918.052951:0:22701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305918.052952:0:22701:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788305918.052954:0:22701:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788305918.052956:0:22701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305918.052958:0:22701:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788305918.052961:0:22701:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788305918.052964:0:22701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788305918.052965:0:22701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788305918.052966:0:22701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305918.052967:0:22701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305918.052973:0:22701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305918.052974:0:22701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305918.052975:0:22701:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788305918.052976:0:22701:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788305918.052977:0:22701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305918.052978:0:22701:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788305918.052992:0:22701:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788305918.053000:0:22701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015352576:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788305918.053030:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305918.053049:0:22701:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891c0fbf840 going to sleep for 11 seconds 00000100:00100000:2.0:1788305918.055467:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015352576 00000100:00100000:2.0:1788305918.055479:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015352576 00000100:00100000:2.0:1788305918.055531:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788305918.055540:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:22701:x1875174015352576:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788305918.055584:0:22714:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788305918.055597:0:22714:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788305918.058908:0:22714:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788305918.058922:0:22714:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788305918.059227:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:22701:x1875174015352576:12345-0@lo:253:mount.lustre.0 Request processed in 3683us (6190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305918.059240:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 20000000:01000000:2.0:1788305918.062343:0:22737:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788305918.062351:0:22737:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788305918.062375:0:22737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6054fd8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305918.062392:0:22737:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181683600/0x4a426866e6054fa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6054fa0 expref: 11 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305918.062402:0:22737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6054fd8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305918.062450:0:22737:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181683600/0x4a426866e6054fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e6054fa0 expref: 11 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305918.062464:0:22737:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889181683600/0x4a426866e6054fa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e6054fa0 expref: 11 pid: 22716 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305918.062477:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22737:1875174015352704:0@lo:104: 00000100:00100000:2.0:1788305918.062539:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305918.062687:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918ab2c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305918.062828:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015352704 00000100:00100000:1.0:1788305918.062835:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015352704 00000100:00100000:1.0:1788305918.062884:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305918.062893:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9915f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4402ecd-e8a2-4271-82d7-771a7bb97982+3:22737:x1875174015352704:12345-0@lo:104: 00010000:00010000:1.0:1788305918.062905:0:22705:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891a523ba00/0x4a426866e6054fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6054fa7 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305918.062961:0:22705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788305918.062968:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9915f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4402ecd-e8a2-4271-82d7-771a7bb97982+3:22737:x1875174015352704:12345-0@lo:104: Request processed in 76us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305918.062975:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305918.063008:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22737:1875174015352704:0@lo:104: 00010000:00010000:1.0:1788305918.063027:0:22737:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6054fd8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305918.063367:0:22701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:22701:1875174015352576:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788305918.063379:0:22701:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788305918.063382:0:22701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788305918.063383:0:22701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788305918.063385:0:22701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305918.063386:0:22701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305918.063387:0:22701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305918.063389:0:22701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305918.063390:0:22701:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788305918.063391:0:22701:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788305918.063394:0:22701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305918.063395:0:22701:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788305918.063406:0:22701:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788305918.069397:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305918.069411:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891a523ba00/0x4a426866e6054fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6054fa7 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305918.069423:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523ba00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:0.0:1788305918.069428:0:22711:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891a523ba00/0x4a426866e6054fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6054fa7 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305918.069439:0:22711:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891a523ba00/0x4a426866e6054fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6054fa7 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305918.069447:0:22711:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891a523ba00/0x4a426866e6054fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6054fa7 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305918.069453:0:22711:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788305918.069509:0:22711:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891a523ba00/0x4a426866e6054fa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054fa7 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305918.069515:0:22711:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305918.069544:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891a523ba00/0x4a426866e6054fa0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054fa7 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305918.069552:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1788305918.069562:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891a523ba00/0x4a426866e6054fa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054fa7 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305918.069573:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4402ecd-e8a2-4271-82d7-771a7bb97982:3649:1875174015352832:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305918.069589:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305918.069591:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305918.069593:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305918.069639:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305918.071425:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015352832 00000100:00100000:0.0:1788305918.071436:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015352832 00010000:00010000:0.0:1788305918.071472:0:22707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181683600/0x4a426866e6054fa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6054fa0 expref: 12 pid: 22716 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305918.071506:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305918.071515:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:3649:x1875174015352832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305918.071528:0:22707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305918.071534:0:22707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181683600/0x4a426866e6054fa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6054fa0 expref: 12 pid: 22716 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305918.071546:0:22707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181683600/0x4a426866e6054fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e6054fa0 expref: 12 pid: 22716 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305918.071576:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181683600/0x4a426866e6054fa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e6054fa0 expref: 12 pid: 22716 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305918.071594:0:22707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6054fd8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305918.071602:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6054fd8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788305918.071619:0:22707:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009268575s 00010000:00010000:0.0:1788305918.071624:0:22707:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6054fd8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305918.071644:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6054fd8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305918.071652:0:22707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6054fd8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305918.071658:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6054fd8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305918.071665:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebe00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305918.071670:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6054fd8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305918.071678:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6054fd8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305918.071692:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6054fd8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305918.071702:0:22707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305918.071775:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4402ecd-e8a2-4271-82d7-771a7bb97982+11:3649:x1875174015352832:12345-0@lo:103:ldlm_bl.0 Request processed in 250us (2125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305918.071783:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788305918.074011:0:22737:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6054fd8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305918.074026:0:22737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6054fd8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305918.074033:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6054fd8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305918.074200:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4402ecd-e8a2-4271-82d7-771a7bb97982:3649:1875174015352832:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788305918.081635:0:22701:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:3.0:1788305918.081984:0:22701:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788305918.082232:0:22762:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788305918.082381:0:22701:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:2.0:1788305918.082665:0:22763:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8891b9914000 x1875174015352960/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305918.082676:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0aec00 going to sleep for 0 seconds 00000040:01000000:3.0:1788305918.082995:0:22701:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788305918.083032:0:22701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788305918.083564:0:22701:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788305918.083571:0:22701:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788305918.083606:0:22701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305918.084706:0:22701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788305918.085215:0:22701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788305918.085245:0:22701:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000020:00080000:1.0:1788305918.089458:0:22761:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:1.0:1788305918.089468:0:22761:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:00080000:3.0:1788305918.089942:0:22701:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1788305918.090513:0:22701:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000040:00080000:2.0:1788305918.094466:0:22762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:3.0:1788305918.097635:0:22701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:2.0:1788305918.098519:0:22762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788305918.098587:0:22762:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000001:00080000:2.0:1788305918.107203:0:22701:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788305918.107252:0:22701:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff94a3c15ef988 00100000:10000000:2.0:1788305918.107262:0:22701:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788305918.108311:0:22701:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788305918.108328:0:22701:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.155@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788305918.108347:0:22701:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788305918.108370:0:22701:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788305918.110580:0:22701:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788305918.110828:0:22701:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788305918.687201:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788305918.933385:0:22720:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788305918.933394:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8891bbb3a800 from 11 10000000:01000000:3.0:1788305918.933399:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788305918.933455:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e6054fdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305918.933467:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e6054fdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305918.933478:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e6054fdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305918.933504:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188562300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015353088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788305918.933598:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305918.934973:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825686c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305918.937200:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015353088 00000100:00100000:2.0:1788305918.937216:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015353088 00000100:00100000:2.0:1788305918.937316:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788305918.937329:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+11:22720:x1875174015353088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305918.937350:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305918.937373:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891bb3ea000/0x4a426866e6054fe6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6054fdf expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305918.937402:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3ea000/0x4a426866e6054fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6054fdf expref: 12 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305918.937413:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891bb3ea000/0x4a426866e6054fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6054fdf expref: 12 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305918.937423:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ea000, rc 0) 00000100:00100000:2.0:1788305918.937510:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:22720:x1875174015353088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (3911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305918.937517:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788305918.937779:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188562300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015353088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305918.937799:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e6054fdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054fe6 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305918.937809:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e6054fdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054fe6 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305918.937886:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015353216:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788305918.937925:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305918.937965:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908333b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788305918.938634:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015353216 00000100:00100000:2.0:1788305918.938641:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015353216 00000100:00100000:2.0:1788305918.938686:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788305918.938694:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:22720:x1875174015353216:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788305918.938721:0:22714:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788305918.938737:0:22714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788305918.938740:0:22714:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788305918.938833:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:22720:x1875174015353216:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305918.938840:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788305918.939168:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015353216:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788305918.939228:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788305918.939236:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e6054fdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054fe6 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305918.939245:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e6054fdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054fe6 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788305919.067024:0:22756:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788305919.067032:0:22756:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788305919.069471:0:22756:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788305919.069484:0:22756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788305919.127351:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0aec00 going to sleep for 0 seconds 00010000:00010000:2.0:1788305919.703418:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788305920.090539:0:22756:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788305920.090549:0:22756:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788305920.090678:0:22756:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1788305920.090717:0:22756:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788305920.092334:0:22756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1788305920.153721:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0aec00 going to sleep for 0 seconds 00010000:00010000:1.0:1788305920.726006:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305921.173639:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0aec00 going to sleep for 0 seconds 00010000:00010000:2.0:1788305921.751668:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305922.199209:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0aec00 going to sleep for 0 seconds 00010000:00010000:1.0:1788305922.773380:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788305923.030393:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788305923.030410:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788305923.030414:0:8:0:(import.c:65:import_set_state_nolock()) ffff8891bb1ea800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788305923.030421:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 748 00000100:00080000:0.0:1788305923.030427:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788305923.030433:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8891bb1ea800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788305923.030458:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891afb37480 x1875174015353472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788305923.030475:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305923.030478:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788305923.030481:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305923.030485:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788305923.030487:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788305923.030490:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788305923.030492:0:8:0:(import.c:65:import_set_state_nolock()) ffff889083f75000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788305923.030497:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff889083f75000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788305923.030511:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891afb35180 x1875174015353600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788305923.030556:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305923.030569:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4402ecd-e8a2-4271-82d7-771a7bb97982:3648:1875174015353344:0@lo:400:kworker.0 00000100:00100000:0.0:1788305923.030638:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305923.030696:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015353472:0@lo:38:kworker.0 00000100:00100000:0.0:1788305923.030726:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305923.030745:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875174015353600:0@lo:38:kworker.0 00000100:00100000:0.0:1788305923.030782:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305923.030814:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015353344 00000100:00100000:0.0:1788305923.030825:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015353344 00000100:00100000:0.0:1788305923.030868:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788305923.030877:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083098850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:3648:x1875174015353344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305923.030920:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083098850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:3648:x1875174015353344:12345-0@lo:400:kworker.0 Request processed in 45us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305923.030928:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788305923.030987:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015353472 00000100:00100000:0.0:1788305923.030992:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015353472 00000100:00100000:0.0:1788305923.031095:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788305923.031100:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875174015353472:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788305923.031117:0:22727:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788305923.031154:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875174015353472:12345-0@lo:38:kworker.0 Request processed in 52us (427us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788305923.031161:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788305923.031199:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bb1ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305923.031203:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788305923.031206:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015353472:0@lo:38:kworker.0 00000100:00100000:0.0:1788305923.031232:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4402ecd-e8a2-4271-82d7-771a7bb97982:3648:1875174015353344:0@lo:400:kworker.0 00000100:00100000:3.0:1788305923.031553:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015353600 00000100:00100000:3.0:1788305923.031559:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015353600 00000100:00100000:3.0:1788305923.034974:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305923.034986:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875174015353600:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788305923.035255:0:22723:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 753 last 0 00000020:00000080:3.0:1788305923.035323:0:22723:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4a426866e6054fed 00000004:00100000:3.0:1788305923.035343:0:22723:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788305923.035485:0:22723:0:(import.c:65:import_set_state_nolock()) ffff889184049800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788305923.035573:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875174015353600:12345-0@lo:38:kworker.0 Request processed in 587us (4790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305923.035581:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788305923.035755:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8891afb35180 x1875174015353600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788305923.035770:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788305923.035777:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788305923.035781:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788305923.035784:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889083f75000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788305923.035789:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875174015353600:0@lo:38:kworker.0 00000100:00100000:2.0:1788305923.222835:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0aec00 going to sleep for 0 seconds 00000001:02000400:1.0:1788305923.290143:0:23006:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788305923.797507:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305924.245611:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0aec00 going to sleep for 0 seconds 00000020:00000004:1.0:1788305924.396955:0:23058:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788305924.397859:0:23058:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788305924.824485:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305925.274934:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0aec00 going to sleep for 0 seconds 00000020:00000004:2.0:1788305925.367184:0:23108:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788305925.367575:0:23108:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788305925.845726:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305926.303424:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0aec00 going to sleep for 0 seconds 00010000:00010000:1.0:1788305926.871866:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305927.126423:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305917/real 1788305917] req@ffff889188560a80 x1875174015350528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305927 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305927.126455:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889188560a80 x1875174015350528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305927 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305927.126465:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305917/real 1788305917] req@ffff889188563b80 x1875174015350400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305927 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305927.126496:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889188563b80 x1875174015350400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305927 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788305927.126515:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908353f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305927.126585:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788305927.126590:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015350528:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788305927.126596:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bb1ed800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305927.129663:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788305927.129670:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788305927.129698:0:8:0:(import.c:65:import_set_state_nolock()) ffff8891bb1ea800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305927.129706:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 753 00000100:00080000:1.0:1788305927.129711:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788305927.129717:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8891bb1ea800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305927.129740:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb23ea00 x1875174015353856/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305927.129751:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305927.129754:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788305927.129756:0:8:0:(import.c:65:import_set_state_nolock()) ffff8891bb1ed800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305927.129759:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 748 00000100:00080000:1.0:1788305927.129762:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788305927.129765:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8891bb1ed800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305927.129775:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb23f800 x1875174015353984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305927.129783:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305927.129786:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788305927.129788:0:8:0:(import.c:65:import_set_state_nolock()) ffff88908353f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305927.129791:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 748 00000100:00080000:1.0:1788305927.129793:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788305927.129795:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88908353f000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305927.129804:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb23d180 x1875174015354112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788305927.129851:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788305927.129866:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4402ecd-e8a2-4271-82d7-771a7bb97982:3647:1875174015353728:0@lo:400:kworker.0 00000100:00100000:1.0:1788305927.129939:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305927.130328:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305927.130339:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015354240:0@lo:400:kworker.0 00000100:00100000:3.0:1788305927.130380:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305927.130451:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015354240 00000100:00100000:3.0:1788305927.130460:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015354240 00000100:00100000:3.0:1788305927.130493:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788305927.130499:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015354240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305927.130548:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015354240:12345-0@lo:400:kworker.0 Request processed in 48us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305927.130554:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305927.130666:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015353728 00000100:00100000:1.0:1788305927.130670:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015353728 00000100:00100000:1.0:1788305927.130703:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788305927.130708:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083098450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:3647:x1875174015353728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305927.130736:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083098450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:3647:x1875174015353728:12345-0@lo:400:kworker.0 Request processed in 27us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305927.130742:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788305927.130796:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4402ecd-e8a2-4271-82d7-771a7bb97982:3647:1875174015353728:0@lo:400:kworker.0 00000100:00080000:0.0:1788305927.131522:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788305927.131531:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015350400:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788305927.131566:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015353856:0@lo:38:kworker.0 00000100:00100000:0.0:1788305927.132234:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305927.132272:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015353856 00000100:00100000:0.0:1788305927.132294:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015353856 00000100:00100000:0.0:1788305927.132333:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788305927.132339:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875174015353856:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788305927.132358:0:22727:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788305927.132397:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875174015353856:12345-0@lo:38:kworker.0 Request processed in 56us (164us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788305927.132404:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788305927.132444:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bb1ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305927.132448:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788305927.132451:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015353856:0@lo:38:kworker.0 00000100:00100000:0.0:1788305927.132460:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015353984:0@lo:8:kworker.0 00000400:00000100:0.0:1788305927.132485:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875174015353984 offset 0 length 520: 4 00000100:00100000:0.0:1788305927.132518:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015354112:0@lo:8:kworker.0 00000400:00000100:0.0:1788305927.132539:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875174015354112 offset 0 length 520: 4 00010000:00080000:2.0:1788305927.134463:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8891bb23d500 x1875174015354240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305927.134481:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015354240:0@lo:400:kworker.0 00000100:00100000:3.0:1788305927.318350:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0aec00 going to sleep for 0 seconds 00010000:00010000:2.0:1788305927.893473:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305928.341626:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0aec00 going to sleep for 0 seconds 00010000:00010000:3.0:1788305928.921239:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305929.365451:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0aec00 going to sleep for 0 seconds 00010000:00010000:2.0:1788305929.941442:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788305930.328801:0:22756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788305930.390114:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0aec00 going to sleep for 0 seconds 00010000:00010000:2.0:1788305930.965911:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305931.413434:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0aec00 going to sleep for 0 seconds 00010000:00010000:3.0:1788305931.990452:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788305932.247148:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788305932.247156:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788305932.247168:0:8:0:(import.c:65:import_set_state_nolock()) ffff8891bb1ea800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788305932.247177:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 757 00000100:00080000:3.0:1788305932.247183:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788305932.247190:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8891bb1ea800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305932.247214:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889188561880 x1875174015354496/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788305932.247229:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788305932.247232:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788305932.247235:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788305932.247238:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788305932.247273:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788305932.247352:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4402ecd-e8a2-4271-82d7-771a7bb97982:3649:1875174015354368:0@lo:400:kworker.0 00000100:00100000:3.0:1788305932.247434:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305932.247489:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015354624:0@lo:400:kworker.0 00000100:00100000:3.0:1788305932.247541:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305932.247578:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015354624 00000100:00100000:3.0:1788305932.247585:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015354624 00000100:00100000:3.0:1788305932.247629:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305932.247639:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015354624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305932.247691:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015354624:12345-0@lo:400:kworker.0 Request processed in 53us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305932.247712:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788305932.247754:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff889188563800 x1875174015354624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305932.247766:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015354624:0@lo:400:kworker.0 00000100:00100000:0.0:1788305932.247898:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015354368 00000100:00100000:0.0:1788305932.247904:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015354368 00000100:00100000:0.0:1788305932.247942:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788305932.247951:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083098050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:3649:x1875174015354368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305932.248004:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083098050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:3649:x1875174015354368:12345-0@lo:400:kworker.0 Request processed in 55us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305932.248011:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788305932.248041:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015354496:0@lo:38:kworker.0 00000100:00100000:0.0:1788305932.248065:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305932.248098:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015354496 00000100:00100000:1.0:1788305932.248102:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4402ecd-e8a2-4271-82d7-771a7bb97982:3649:1875174015354368:0@lo:400:kworker.0 00000100:00100000:0.0:1788305932.248103:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015354496 00000100:00100000:0.0:1788305932.248124:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788305932.248130:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875174015354496:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788305932.248145:0:22727:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788305932.248194:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875174015354496:12345-0@lo:38:kworker.0 Request processed in 62us (127us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788305932.248200:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788305932.248337:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bb1ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305932.248343:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788305932.248350:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015354496:0@lo:38:kworker.0 00000100:00100000:2.0:1788305932.438822:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0aec00 going to sleep for 0 seconds 00000020:01000004:2.0:1788305932.918555:0:23455:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788305932.918558:0:23455:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788305932.918559:0:23455:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788305932.918687:0:23455:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8891bfab2000 00000020:01000004:2.0:1788305932.918703:0:23455:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1788305932.918714:0:23455:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788305932.918728:0:23455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff88908357b370) 00000020:00000080:2.0:1788305932.918745:0:23455:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1788305933.013736:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788305933.047683:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788305933.049074:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788305933.052004:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788305933.052405:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788305933.052704:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788305933.053050:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788305933.053427:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788305933.053660:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788305933.054167:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788305933.054510:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788305933.055090:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788305933.055329:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788305933.055649:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788305933.055953:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788305933.056414:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788305933.056601:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788305933.057075:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788305933.057509:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788305933.057924:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788305933.058197:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1788305933.058674:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1788305933.059014:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788305933.059464:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1788305933.059722:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788305933.062241:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1788305933.063213:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1788305933.063639:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788305933.064109:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788305933.064507:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788305933.064763:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788305933.065202:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1788305933.066742:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788305933.068547:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1788305933.069217:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788305933.071246:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1788305933.071630:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788305933.072299:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788305933.072603:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788305933.072809:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788305933.073480:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788305933.073703:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1788305933.073883:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788305933.074505:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788305933.074816:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788305933.076810:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1788305933.078446:0:23455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1788305933.083689:0:23455:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788305933.084209:0:23455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1788305933.084221:0:23455:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788305933.084231:0:23455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4a426866e6054ffb 00000020:01000004:1.0:1788305933.084239:0:23455:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788305933.084259:0:23455:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.155@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788305933.084262:0:23455:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788305933.084689:0:23455:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1788305933.084722:0:23455:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1788305933.084726:0:23455:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.155@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788305933.106185:0:23455:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.155@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788305933.106246:0:23455:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.155@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1788305933.106252:0:23455:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788305933.106254:0:23455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788305933.106255:0:23455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305933.106256:0:23455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305933.106257:0:23455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305933.106259:0:23455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305933.106260:0:23455:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788305933.106262:0:23455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305933.106264:0:23455:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788305933.106443:0:23455:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1788305933.106446:0:23455:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788305933.106448:0:23455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788305933.106449:0:23455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305933.106450:0:23455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305933.106451:0:23455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305933.106452:0:23455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305933.106453:0:23455:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788305933.106454:0:23455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305933.106455:0:23455:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788305933.106481:0:23455:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788305933.106502:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015354752:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788305933.106585:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305933.106634:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305933.106703:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015354752 00000100:00100000:1.0:1788305933.106710:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015354752 00000100:00100000:1.0:1788305933.106764:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788305933.106781:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083099050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:23455:x1875174015354752:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788305933.106826:0:22716:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788305933.106829:0:22716:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1788305933.106837:0:22716:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788305933.107599:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083099050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:23455:x1875174015354752:12345-0@lo:253:mount.lustre.0 Request processed in 816us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305933.107608:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788305933.107716:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015354752:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788305933.107737:0:23455:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788305933.107740:0:23455:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788305933.107742:0:23455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788305933.107743:0:23455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305933.107744:0:23455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305933.107745:0:23455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305933.107746:0:23455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305933.107747:0:23455:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788305933.107749:0:23455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305933.107750:0:23455:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788305933.107769:0:23455:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8891bfab2000 from lustre-MDT0001 10000000:01000000:2.0:1788305933.107799:0:23455:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788305933.108253:0:23455:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788305933.108261:0:23455:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff889184028000 local copy 00010000:00010000:2.0:1788305933.108380:0:23455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054ef1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054ef8 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305933.108475:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015354880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305933.108511:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305933.108546:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff88919e0bf840 going to sleep for 11 seconds 00000100:00100000:0.0:1788305933.108787:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015354880 00000100:00100000:0.0:1788305933.108793:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015354880 00000100:00100000:0.0:1788305933.108856:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788305933.108866:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908309bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:23455:x1875174015354880:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305933.109180:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908309bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:23455:x1875174015354880:12345-0@lo:501:mount.lustre.0 Request processed in 316us (668us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788305933.109188:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788305933.109466:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015354880:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788305933.109481:0:23455:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788305933.109502:0:23455:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788305933.109508:0:23455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054ef1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054ef8 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.109517:0:23455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054ef1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054ef8 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305933.109540:0:23455:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8891bfab2000 10000000:01000000:2.0:1788305933.109553:0:23455:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788305933.109558:0:23455:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff889184028000 10000000:01000000:2.0:1788305933.109560:0:23455:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788305933.109563:0:23455:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff889184028000 from 1 10000000:01000000:2.0:1788305933.109565:0:23455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788305933.109588:0:23455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e6055002 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.109597:0:23455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e6055002 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.109605:0:23455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e6055002 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305933.109619:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015355008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788305933.109648:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305933.109668:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff88919e0bf840 going to sleep for 11 seconds 00000100:00100000:0.0:1788305933.110444:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015355008 00000100:00100000:0.0:1788305933.110452:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015355008 00000100:00100000:0.0:1788305933.110499:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788305933.110508:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908309b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+12:23455:x1875174015355008:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305933.110518:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305933.110531:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891a523b400/0x4a426866e6055009 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6055002 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305933.110551:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891a523b400/0x4a426866e6055009 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6055002 expref: 13 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305933.110575:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891a523b400/0x4a426866e6055009 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6055002 expref: 13 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305933.110584:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523b400, rc 0) 00000100:00100000:0.0:1788305933.110643:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908309b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+13:23455:x1875174015355008:12345-0@lo:101:mount.lustre.0 Request processed in 136us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305933.110649:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788305933.111062:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015355008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305933.111077:0:23455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e6055002 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055009 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.111086:0:23455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e6055002 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6055009 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305933.111103:0:23455:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788305933.111122:0:23455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e6055002 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055009 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.111130:0:23455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e6055002 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055009 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305933.111140:0:23455:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8891bfab2000 10000000:01000000:3.0:1788305933.111145:0:23455:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788305933.111149:0:23455:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8891bfab2000 from 1 10000000:01000000:3.0:1788305933.111162:0:23455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788305933.111182:0:23455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181682800/0x4a426866e6055010 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.111190:0:23455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889181682800/0x4a426866e6055010 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.111210:0:23455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889181682800/0x4a426866e6055010 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305933.111226:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188561880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015355136:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788305933.111256:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305933.111513:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788305933.111613:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015355136 00000100:00100000:0.0:1788305933.111618:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015355136 00000100:00100000:0.0:1788305933.111655:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788305933.111663:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083099450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+13:23455:x1875174015355136:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305933.111683:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305933.111694:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891a523aa00/0x4a426866e6055017 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6055010 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305933.111710:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891a523aa00/0x4a426866e6055017 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6055010 expref: 14 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305933.111719:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891a523aa00/0x4a426866e6055017 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6055010 expref: 14 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305933.111726:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523aa00, rc 0) 00000100:00100000:0.0:1788305933.111766:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083099450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+14:23455:x1875174015355136:12345-0@lo:101:mount.lustre.0 Request processed in 104us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305933.111771:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788305933.112100:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188561880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015355136:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305933.112112:0:23455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889181682800/0x4a426866e6055010 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055017 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.112121:0:23455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889181682800/0x4a426866e6055010 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6055017 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305933.112134:0:23455:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788305933.112148:0:23455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181682800/0x4a426866e6055010 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055017 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.112164:0:23455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889181682800/0x4a426866e6055010 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055017 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305933.112170:0:23455:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788305933.112175:0:23455:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788305933.112179:0:23455:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8891bfab2000 10000000:01000000:3.0:1788305933.112182:0:23455:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788305933.112185:0:23455:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788305933.112187:0:23455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788305933.112202:0:23455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181683c00/0x4a426866e605501e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.112218:0:23455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889181683c00/0x4a426866e605501e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.112226:0:23455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889181683c00/0x4a426866e605501e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305933.112240:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188561880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015355264:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788305933.112297:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305933.112518:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788305933.113800:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015355264 00000100:00100000:0.0:1788305933.113821:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015355264 00000100:00100000:0.0:1788305933.113888:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788305933.113898:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908309a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+14:23455:x1875174015355264:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305933.113919:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305933.113936:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891a523bc00/0x4a426866e6055025 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605501e expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305933.113960:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891a523bc00/0x4a426866e6055025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605501e expref: 15 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305933.113970:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891a523bc00/0x4a426866e6055025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605501e expref: 15 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305933.113979:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523bc00, rc 0) 00000100:00100000:0.0:1788305933.114046:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908309a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+15:23455:x1875174015355264:12345-0@lo:101:mount.lustre.0 Request processed in 150us (1778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305933.114053:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788305933.114227:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188561880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015355264:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305933.114242:0:23455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889181683c00/0x4a426866e605501e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055025 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.114252:0:23455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889181683c00/0x4a426866e605501e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6055025 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788305933.116635:0:23455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1788305933.119082:0:23455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305933.129537:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788305933.129609:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1788305933.129627:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1788305933.129643:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1788305933.129657:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1788305933.129797:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1788305933.131057:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1788305933.131085:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1788305933.131104:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1788305933.131118:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1788305933.131149:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1788305933.131178:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1788305933.131192:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1788305933.131203:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1788305933.131217:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1788305933.131231:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1788305933.131245:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1788305933.131256:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1788305933.131267:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1788305933.131299:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1788305933.131314:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1788305933.131326:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1788305933.131338:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1788305933.131353:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1788305933.131367:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1788305933.131380:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1788305933.131395:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1788305933.131409:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1788305933.131421:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1788305933.131434:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1788305933.131448:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1788305933.131461:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1788305933.131473:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1788305933.131487:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1788305933.131501:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1788305933.131512:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1788305933.131526:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1788305933.131538:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1788305933.131549:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1788305933.131562:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1788305933.131575:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1788305933.131589:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1788305933.131602:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1788305933.131631:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1788305933.131662:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1788305933.131668:0:23455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1788305933.131765:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188561880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015355392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305933.131834:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305933.131881:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2900 going to sleep for 11 seconds 00000100:00100000:2.0:1788305933.131949:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015355392 00000100:00100000:2.0:1788305933.131957:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015355392 00000100:00100000:2.0:1788305933.132008:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788305933.132017:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083099c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+15:23455:x1875174015355392:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305933.132162:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083099c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+15:23455:x1875174015355392:12345-0@lo:501:mount.lustre.0 Request processed in 136us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305933.132171:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788305933.135653:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188561880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015355392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305933.135718:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188561880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015355520:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788305933.135797:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305933.135831:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2900 going to sleep for 11 seconds 00000100:00100000:0.0:1788305933.136566:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015355520 00000100:00100000:0.0:1788305933.136575:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015355520 00000100:00100000:0.0:1788305933.136623:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788305933.136632:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908309b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+15:23455:x1875174015355520:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788305933.137767:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908309b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+15:23455:x1875174015355520:12345-0@lo:503:mount.lustre.0 Request processed in 1131us (1966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305933.137777:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788305933.142687:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188561880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015355520:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788305933.146852:0:23455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788305933.147190:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015355648:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305933.147453:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305933.147492:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff88919e0bfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788305933.149209:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015355648 00000100:00100000:0.0:1788305933.149223:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015355648 00000100:00100000:0.0:1788305933.149331:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788305933.149342:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908309a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+15:23455:x1875174015355648:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305933.150496:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908309a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+15:23455:x1875174015355648:12345-0@lo:502:mount.lustre.0 Request processed in 1152us (3040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305933.150513:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788305933.150617:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015355648:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788305933.150853:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788305933.150883:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1788305933.150896:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1788305933.150910:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1788305933.150941:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1788305933.150955:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1788305933.150968:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1788305933.150982:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1788305933.150994:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1788305933.151006:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1788305933.151020:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1788305933.151034:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1788305933.151048:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1788305933.151062:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1788305933.151077:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1788305933.151093:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1788305933.151116:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1788305933.151134:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1788305933.151161:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1788305933.151178:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1788305933.151193:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1788305933.151209:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1788305933.151224:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1788305933.151240:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1788305933.151257:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1788305933.151873:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1788305933.151903:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:0.0:1788305933.157076:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:0.0:1788305933.157108:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:0.0:1788305933.157120:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:0.0:1788305933.157131:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:0.0:1788305933.157142:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:0.0:1788305933.157165:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:0.0:1788305933.157179:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:0.0:1788305933.157190:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:0.0:1788305933.157203:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:0.0:1788305933.157218:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:0.0:1788305933.157229:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:0.0:1788305933.157240:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:0.0:1788305933.157251:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:0.0:1788305933.157262:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:0.0:1788305933.157538:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:0.0:1788305933.157553:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:0.0:1788305933.157564:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:0.0:1788305933.157608:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015355776:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305933.157756:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305933.157889:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb56240 going to sleep for 11 seconds 00000100:00100000:1.0:1788305933.160083:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015355776 00000100:00100000:1.0:1788305933.160098:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015355776 00000100:00100000:1.0:1788305933.160161:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788305933.160172:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083099850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+15:23455:x1875174015355776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305933.160573:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083099850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+15:23455:x1875174015355776:12345-0@lo:502:mount.lustre.0 Request processed in 403us (2817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305933.160581:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788305933.160701:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015355776:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788305933.160789:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1788305933.161022:0:23455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1788305933.163871:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788305933.163886:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305933.163888:0:23459:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788305933.163893:0:23459:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788305933.163896:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788305933.164295:0:23459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8890835799b8) 00000020:00000080:2.0:1788305933.164328:0:23459:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1788305933.164336:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788305933.164433:0:23459:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788305933.164440:0:23459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4a426866e6055033 00000020:00000080:2.0:1788305933.164658:0:23459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788305933.164662:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305933.164665:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305933.164667:0:23459:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788305933.164683:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788305933.164687:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305933.164688:0:23459:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788305933.164692:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788305933.164701:0:23459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff889186224d28) 00000020:00000080:2.0:1788305933.164711:0:23459:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1788305933.164715:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788305933.164717:0:23459:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788305933.164720:0:23459:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788305933.164725:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788305933.164767:0:23459:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8891bfab2000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788305933.164779:0:23459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8891862219b8) 00000020:00000080:2.0:1788305933.164788:0:23459:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1788305933.164853:0:23459:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788305933.164859:0:23459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4a426866e6055048 00000020:00000080:2.0:1788305933.165974:0:23459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788305933.165997:0:23459:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788305933.166003:0:23459:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x4a426866e605504f 00080000:01000000:2.0:1788305933.166011:0:23459:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788305933.166016:0:23459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4a426866e6055056 00010000:00010000:2.0:1788305933.318191:0:23459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788305933.319099:0:23459:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1788305933.319530:0:23459:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788305933.338936:0:23459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788305933.338951:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305933.338961:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305933.338963:0:23459:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788305933.338967:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305933.338972:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305933.338974:0:23459:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788305933.338977:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788305933.338982:0:23459:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.155@tcp to nid 0x20000c0a8ca9b (192.168.202.155@tcp) 00000020:00000080:3.0:1788305933.339012:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788305933.339028:0:23459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8891b917cd28) 00000020:00000080:3.0:1788305933.339050:0:23459:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788305933.339055:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788305933.339162:0:23459:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788305933.339169:0:23459:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788305933.339176:0:23459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4a426866e6055064 00010000:00080000:3.0:1788305933.339209:0:23459:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889083e4e000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.155@tcp at head 00010000:00010000:3.0:1788305933.344615:0:23459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788305933.353046:0:23459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788305933.353063:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788305933.353109:0:23459:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788305933.353147:0:23459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4a426866e605506b 00000100:00080000:3.0:1788305933.353191:0:23459:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788305933.353197:0:23459:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff889083e4e000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305933.353235:0:23459:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889188561880 x1875174015355904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788305933.353512:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015355904:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788305933.353584:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788305933.353690:0:23459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1788305933.353755:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305933.353759:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305933.353762:0:23459:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788305933.353765:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788305933.353767:0:23459:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788305933.353769:0:23459:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788305933.353770:0:23459:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788305933.353772:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788305933.353774:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305933.353775:0:23459:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788305933.353777:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305933.353782:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305933.353784:0:23459:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788305933.353787:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788305933.353821:0:23459:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788305933.353834:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305933.353838:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305933.353839:0:23459:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788305933.353842:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788305933.353843:0:23459:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1788305933.353845:0:23459:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788305933.353846:0:23459:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788305933.353848:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788305933.353850:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305933.353852:0:23459:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788305933.353854:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788305933.353857:0:23459:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788305933.353867:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305933.353869:0:23459:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788305933.353873:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788305933.353877:0:23459:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.155@tcp to nid 0x20000c0a8ca9b (192.168.202.155@tcp) 00000020:01000000:3.0:1788305933.353900:0:23459:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788305933.353903:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788305933.353928:0:23459:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8891b91799b8) 00000020:00000080:3.0:1788305933.353942:0:23459:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788305933.353948:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788305933.354019:0:23459:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788305933.354025:0:23459:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788305933.354031:0:23459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4a426866e6055079 00010000:00080000:3.0:1788305933.354068:0:23459:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889183841800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.155@tcp at head 00000100:00080000:2.0:1788305933.355449:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788305933.355459:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788305933.355462:0:36:0:(import.c:65:import_set_state_nolock()) ffff8891bb1ea800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788305933.355469:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 762 00000100:00080000:2.0:1788305933.355473:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788305933.355479:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8891bb1ea800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305933.355515:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891b9915880 x1875174015356032/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1788305933.356566:0:23459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1788305933.356901:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015355904 00000100:00100000:3.0:1788305933.356910:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015355904 00000100:00100000:3.0:1788305933.356949:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788305933.356958:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875174015355904:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788305933.356990:0:22727:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 763 last 0 00000020:00000080:3.0:1788305933.357040:0:22727:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4a426866e6055080 00000004:00100000:3.0:1788305933.357058:0:22727:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788305933.357064:0:22727:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:01000000:3.0:1788305933.365903:0:23459:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788305933.367604:0:23459:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1788305933.370038:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015356032:0@lo:38:kworker.0 00000100:00100000:1.0:1788305933.370108:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305933.370158:0:22726:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788305933.370167:0:22726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00080000:2.0:1788305933.370680:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305933.370686:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788305933.370689:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305933.370692:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788305933.370821:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015356160:0@lo:400:kworker.0 00000100:00100000:2.0:1788305933.370861:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305933.370997:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015356160 00000100:00100000:3.0:1788305933.371006:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015356160 00000100:00100000:3.0:1788305933.371051:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788305933.371061:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015356160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305933.371116:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015356160:12345-0@lo:400:kworker.0 Request processed in 56us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305933.371132:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788305933.371193:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8891b9916300 x1875174015356160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305933.371208:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015356160:0@lo:400:kworker.0 00000100:00100000:0.0:1788305933.373160:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015356032 00000100:00100000:0.0:1788305933.373171:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015356032 00000100:00100000:2.0:1788305933.375287:0:23464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788305933.375525:0:23464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1875174015356032:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788305933.375625:0:23464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1875174015356032:12345-0@lo:38:kworker.0 Request processed in 326us (5516us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788305933.375643:0:23464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:2.0:1788305933.379700:0:23459:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788305933.380806:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1788305933.380988:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:1.0:1788305933.382681:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788305933.382696:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bb1ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305933.382702:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788305933.382707:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015356032:0@lo:38:kworker.0 00000100:00080000:3.0:1788305933.387471:0:22727:0:(import.c:65:import_set_state_nolock()) ffff889183845800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788305933.387573:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1875174015355904:12345-0@lo:38:llog_process_th.0 Request processed in 30613us (33986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305933.387584:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788305933.387688:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788305933.387698:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788305933.387721:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788305933.387726:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788305933.387730:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889083e4e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788305933.387749:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015355904:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788305933.388488:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015356288:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788305933.388534:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305933.388615:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015356288 00000100:00100000:2.0:1788305933.388621:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015356288 00000100:00100000:2.0:1788305933.388663:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788305933.388681:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1875174015356288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788305933.388709:0:22726:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788305933.388797:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1875174015356288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305933.388803:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788305933.389014:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015356288:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788305933.393406:0:23465:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788305933.393416:0:23465:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788305933.404565:0:23459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788305933.404582:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788305933.404636:0:23459:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788305933.404659:0:23459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4a426866e6055087 00000100:00080000:2.0:1788305933.404686:0:23459:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788305933.404693:0:23459:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff889183841800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305933.404729:0:23459:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891b9917100 x1875174015356416/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788305933.404810:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015356416:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788305933.404867:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875174015356416 offset 0 length 520: 4 00000100:00080000:2.0:1788305933.405113:0:23459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788305933.405186:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305933.405192:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305933.405194:0:23459:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788305933.405198:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788305933.405201:0:23459:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1788305933.405203:0:23459:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788305933.405205:0:23459:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788305933.405206:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788305933.405217:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305933.405219:0:23459:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788305933.405223:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788305933.405228:0:23459:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788305933.405231:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305933.405233:0:23459:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788305933.405236:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788305933.405240:0:23459:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.155@tcp to nid 0x20000c0a8ca9b (192.168.202.155@tcp) 00000020:01000000:2.0:1788305933.405297:0:23459:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788305933.405301:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788305933.405313:0:23459:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff889186223370) 00000020:00000080:2.0:1788305933.405326:0:23459:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788305933.405331:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788305933.405391:0:23459:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788305933.405398:0:23459:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788305933.405406:0:23459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4a426866e6055095 00010000:00080000:2.0:1788305933.405436:0:23459:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88908273d800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.155@tcp at head 00010000:00010000:2.0:1788305933.405655:0:23459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000100:00080000:0.0:1788305933.405901:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305933.405906:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788305933.405920:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305933.405931:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:01000000:2.0:1788305933.406089:0:23459:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788305933.406103:0:23459:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788305933.416529:0:23459:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788305933.417501:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788305933.417650:0:23459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1788305933.418679:0:23467:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788305933.418685:0:23467:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788305933.420048:0:23459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788305933.420062:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788305933.420101:0:23459:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788305933.420125:0:23459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4a426866e605509c 00000100:00080000:2.0:1788305933.420136:0:23459:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788305933.420142:0:23459:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff88908273d800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305933.420196:0:23459:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891b9914700 x1875174015356544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788305933.420225:0:23459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788305933.420383:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305933.420387:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305933.420389:0:23459:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788305933.420392:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788305933.420396:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305933.420397:0:23459:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788305933.420400:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788305933.420401:0:23459:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788305933.420403:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305933.420405:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305933.420406:0:23459:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788305933.420407:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788305933.420409:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305933.420410:0:23459:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788305933.420413:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788305933.420440:0:23459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305933.420443:0:23459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305933.420445:0:23459:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788305933.420448:0:23459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00100000:3.0:1788305933.420688:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015356544:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788305933.420747:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875174015356544 offset 0 length 520: 4 00000020:01000000:0.0:1788305933.421194:0:23455:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1788305933.421234:0:23455:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788305933.421261:0:23455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181683c00/0x4a426866e605501e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055025 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305933.421271:0:23455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889181683c00/0x4a426866e605501e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055025 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305933.421441:0:23455:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8891bfab2000 from 1 10000000:01000000:0.0:1788305933.421444:0:23455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788305933.421471:0:23455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60550a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305933.421479:0:23455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60550a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305933.421490:0:23455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60550a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305933.421506:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb34380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015356672:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788305933.421547:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305933.421582:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb56b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788305933.421679:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015356672 00000100:00100000:3.0:1788305933.421686:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015356672 00000100:00100000:3.0:1788305933.421731:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788305933.421741:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908309ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+15:23455:x1875174015356672:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305933.421755:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305933.421766:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181683400/0x4a426866e60550aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60550a3 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.421788:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181683400/0x4a426866e60550aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60550a3 expref: 16 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.421799:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181683400/0x4a426866e60550aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60550a3 expref: 16 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.421822:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181683400, rc 0) 00000100:00100000:3.0:1788305933.421860:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908309ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+16:23455:x1875174015356672:12345-0@lo:101:mount.lustre.0 Request processed in 121us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305933.421867:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788305933.422133:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb34380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015356672:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305933.422147:0:23455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60550a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60550aa expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305933.422166:0:23455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60550a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60550aa expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305933.422849:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb34380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015356800:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788305933.422895:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305933.423255:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb56b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788305933.423305:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015356800 00000100:00100000:0.0:1788305933.423310:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015356800 00000100:00100000:0.0:1788305933.423493:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788305933.423501:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908309a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+16:23455:x1875174015356800:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788305933.423518:0:22715:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788305933.423537:0:22715:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788305933.423540:0:22715:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1788305933.423634:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908309a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+16:23455:x1875174015356800:12345-0@lo:256:mount.lustre.0 Request processed in 134us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305933.423642:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788305933.423792:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb34380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015356800:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788305933.424611:0:23455:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788305933.424634:0:23455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60550a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60550aa expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.424645:0:23455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60550a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60550aa expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305933.425193:0:23455:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8891bfab2000 from 1 10000000:01000000:2.0:1788305933.425205:0:23455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788305933.425236:0:23455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e60550b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.425245:0:23455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e60550b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.425254:0:23455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e60550b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305933.425408:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015356928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788305933.425458:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305933.425490:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0ae180 going to sleep for 11 seconds 00000100:00100000:0.0:1788305933.425539:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015356928 00000100:00100000:0.0:1788305933.425545:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015356928 00000100:00100000:0.0:1788305933.425587:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788305933.425594:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083098c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+16:23455:x1875174015356928:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305933.425605:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305933.425615:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891a523a800/0x4a426866e60550b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60550b1 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305933.425634:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891a523a800/0x4a426866e60550b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60550b1 expref: 17 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305933.425645:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891a523a800/0x4a426866e60550b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60550b1 expref: 17 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305933.425663:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523a800, rc 0) 00000100:00100000:0.0:1788305933.425704:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083098c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+17:23455:x1875174015356928:12345-0@lo:101:mount.lustre.0 Request processed in 110us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305933.425710:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788305933.425937:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015356928:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788305933.425950:0:23455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e60550b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60550b8 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.425958:0:23455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e60550b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60550b8 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788305933.426601:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305933.426607:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788305933.426610:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305933.426613:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1788305933.427647:0:23455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1788305933.428114:0:23455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788305933.428596:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788305933.428621:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1788305933.428636:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1788305933.428650:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1788305933.428662:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1788305933.428774:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1788305933.428791:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1788305933.428803:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1788305933.428817:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788305933.428842:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1788305933.428856:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1788305933.428873:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1788305933.428878:0:23455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1788305933.429119:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015357056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305933.429193:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305933.429336:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0ae9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305933.429505:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015357056 00000100:00100000:3.0:1788305933.429512:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015357056 00000100:00100000:3.0:1788305933.429591:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788305933.429602:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908309b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+17:23455:x1875174015357056:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305933.429821:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908309b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+17:23455:x1875174015357056:12345-0@lo:501:mount.lustre.0 Request processed in 221us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305933.429829:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788305933.429984:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015357056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305933.430019:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015357184:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788305933.430061:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305933.430186:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0ae9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305933.430221:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015357184 00000100:00100000:3.0:1788305933.430225:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015357184 00000100:00100000:3.0:1788305933.430346:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788305933.430354:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+17:23455:x1875174015357184:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788305933.430439:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+17:23455:x1875174015357184:12345-0@lo:503:mount.lustre.0 Request processed in 85us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305933.430446:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788305933.430525:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015357184:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788305933.430924:0:23455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788305933.430979:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015357312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305933.431014:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305933.431464:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0ae180 going to sleep for 11 seconds 00000100:00100000:1.0:1788305933.431500:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015357312 00000100:00100000:1.0:1788305933.431506:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015357312 00000100:00100000:1.0:1788305933.431534:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788305933.431542:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+17:23455:x1875174015357312:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305933.431640:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+17:23455:x1875174015357312:12345-0@lo:502:mount.lustre.0 Request processed in 98us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305933.431648:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788305933.431801:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015357312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788305933.432249:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788305933.432388:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1788305933.432410:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1788305933.432425:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1788305933.432441:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1788305933.432457:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1788305933.432471:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1788305933.432503:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1788305933.432519:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788305933.432532:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1788305933.432556:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1788305933.432583:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015357440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305933.432633:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305933.432658:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0ae180 going to sleep for 11 seconds 00000100:00100000:1.0:1788305933.432780:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015357440 00000100:00100000:1.0:1788305933.432785:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015357440 00000100:00100000:1.0:1788305933.432810:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788305933.432818:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+17:23455:x1875174015357440:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305933.433610:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+17:23455:x1875174015357440:12345-0@lo:502:mount.lustre.0 Request processed in 790us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305933.433620:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788305933.433794:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015357440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788305933.433853:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1788305933.433862:0:23455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788305933.434977:0:23469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305933.434988:0:23469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305933.434990:0:23469:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788305933.434997:0:23469:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8891bfab2000 00000020:00000080:1.0:1788305933.434999:0:23469:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788305933.435011:0:23469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305933.435013:0:23469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305933.435014:0:23469:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788305933.435016:0:23469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305933.435019:0:23469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305933.435020:0:23469:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788305933.435023:0:23469:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8891bfab2000 00000020:00000080:1.0:1788305933.435025:0:23469:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788305933.435120:0:23469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305933.435124:0:23469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305933.435125:0:23469:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788305933.435127:0:23469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305933.435129:0:23469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305933.435131:0:23469:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788305933.435134:0:23469:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8891bfab2000 00000020:00000080:1.0:1788305933.435136:0:23469:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788305933.442454:0:23469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305933.442547:0:23469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305933.442550:0:23469:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788305933.442555:0:23469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305933.442559:0:23469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305933.442561:0:23469:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788305933.442567:0:23469:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8891bfab2000 00000020:00000080:1.0:1788305933.442569:0:23469:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788305933.442634:0:23469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305933.442638:0:23469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305933.442640:0:23469:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788305933.442643:0:23469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:0.0:1788305933.446453:0:23455:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788305933.446501:0:23455:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788305933.446530:0:23455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e60550b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60550b8 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305933.446544:0:23455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e60550b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60550b8 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305933.446606:0:23455:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788305933.446609:0:23455:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8891bfab2000 10000000:01000000:0.0:1788305933.446613:0:23455:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8891bfab2000 10000000:01000000:0.0:1788305933.446618:0:23455:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788305933.446624:0:23455:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8891bfab2000 from 1 10000000:01000000:0.0:1788305933.446626:0:23455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788305933.446663:0:23455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e60550bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305933.447407:0:23455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e60550bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305933.447426:0:23455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e60550bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305933.447450:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015357568:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788305933.447514:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305933.447558:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb56300 going to sleep for 11 seconds 00000100:00100000:3.0:1788305933.449205:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015357568 00000100:00100000:3.0:1788305933.449216:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015357568 00000100:00100000:3.0:1788305933.449264:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788305933.449290:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+17:23455:x1875174015357568:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305933.449305:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305933.449388:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181682000/0x4a426866e60550c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60550bf expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.449427:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181682000/0x4a426866e60550c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60550bf expref: 18 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.449439:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181682000/0x4a426866e60550c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60550bf expref: 18 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.449449:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181682000, rc 0) 00000100:00100000:3.0:1788305933.449513:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:23455:x1875174015357568:12345-0@lo:101:mount.lustre.0 Request processed in 240us (1999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305933.449520:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788305933.449589:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015357568:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305933.449605:0:23455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e60550bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60550c6 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.449614:0:23455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e60550bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60550c6 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788305933.465778:0:23455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1788305933.466234:0:23455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788305933.466620:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1788305933.466647:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000100:00100000:3.0:1788305933.467422:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0aec00 going to sleep for 0 seconds 00000040:00080000:0.0:1788305933.468011:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1788305933.469426:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1788305933.469461:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1788305933.469477:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1788305933.469492:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1788305933.469507:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1788305933.469521:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1788305933.469535:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1788305933.469551:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1788305933.469569:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1788305933.469586:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1788305933.469602:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1788305933.469618:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1788305933.469634:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1788305933.469649:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1788305933.470474:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1788305933.470503:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1788305933.470517:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1788305933.470530:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1788305933.470545:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1788305933.470560:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1788305933.470577:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1788305933.470591:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1788305933.470605:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1788305933.470618:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1788305933.470656:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1788305933.471409:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1788305933.471432:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1788305933.471445:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1788305933.471457:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1788305933.471470:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1788305933.471481:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1788305933.471495:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1788305933.471507:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1788305933.471519:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1788305933.471532:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1788305933.471545:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1788305933.471556:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1788305933.471566:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1788305933.471578:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1788305933.471590:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1788305933.471617:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1788305933.471631:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1788305933.471642:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1788305933.471652:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1788305933.471664:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1788305933.473228:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1788305933.473253:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1788305933.473270:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1788305933.473301:0:23455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1788305933.474108:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015357696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305933.474188:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305933.474241:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff889181254d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305933.474425:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015357696 00000100:00100000:0.0:1788305933.474433:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015357696 00000100:00100000:0.0:1788305933.474492:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788305933.474501:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:23455:x1875174015357696:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305933.474622:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:23455:x1875174015357696:12345-0@lo:501:mount.lustre.0 Request processed in 121us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305933.474630:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788305933.475814:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015357696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305933.475862:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015357824:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788305933.476832:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305933.476879:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff889181254d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305933.477423:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015357824 00000100:00100000:0.0:1788305933.477431:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015357824 00000100:00100000:0.0:1788305933.477473:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788305933.477482:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:23455:x1875174015357824:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788305933.477593:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:23455:x1875174015357824:12345-0@lo:503:mount.lustre.0 Request processed in 111us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305933.477601:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788305933.477852:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015357824:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788305933.480508:0:23455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788305933.480603:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015357952:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305933.481429:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305933.481516:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff889181254d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305933.486543:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015357952 00000100:00100000:0.0:1788305933.490865:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015357952 00000100:00100000:0.0:1788305933.491029:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788305933.491041:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:23455:x1875174015357952:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305933.491238:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:23455:x1875174015357952:12345-0@lo:502:mount.lustre.0 Request processed in 200us (9811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305933.491247:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788305933.491375:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015357952:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788305933.491617:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1788305933.491650:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1788305933.491683:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1788305933.491701:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1788305933.491730:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1788305933.491746:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1788305933.491760:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1788305933.491774:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1788305933.491789:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1788305933.491803:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1788305933.491819:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1788305933.491830:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1788305933.491842:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1788305933.491854:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1788305933.491868:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1788305933.491880:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1788305933.491892:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1788305933.491905:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1788305933.492223:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1788305933.492239:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1788305933.492269:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1788305933.492330:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1788305933.492345:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1788305933.492359:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1788305933.492373:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1788305933.492386:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1788305933.492399:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1788305933.492412:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1788305933.492424:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1788305933.492436:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1788305933.492447:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1788305933.492459:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1788305933.492471:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1788305933.492483:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1788305933.492496:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1788305933.492510:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1788305933.492537:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1788305933.492551:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1788305933.492564:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1788305933.492575:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1788305933.492586:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1788305933.492598:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1788305933.492612:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1788305933.492627:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1788305933.492639:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1788305933.492651:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1788305933.492865:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1788305933.492887:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1788305933.493009:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015358080:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305933.493072:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305933.493569:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff889181254d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305933.493617:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015358080 00000100:00100000:1.0:1788305933.493625:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015358080 00000100:00100000:1.0:1788305933.493661:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788305933.493747:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:23455:x1875174015358080:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305933.494306:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:23455:x1875174015358080:12345-0@lo:502:mount.lustre.0 Request processed in 635us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305933.494330:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788305933.498868:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015358080:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788305933.499783:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1788305933.499862:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1788305933.499904:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015358208:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305933.500503:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305933.500588:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff889181254d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305933.508164:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015358208 00000100:00100000:1.0:1788305933.508179:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015358208 00000100:00100000:1.0:1788305933.508305:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788305933.509782:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:23455:x1875174015358208:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305933.509975:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:23455:x1875174015358208:12345-0@lo:502:mount.lustre.0 Request processed in 1660us (9472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305933.509985:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788305933.510087:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015358208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788305933.510187:0:23455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1788305933.510200:0:23455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788305933.518763:0:23475:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788305933.518781:0:23475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8890833d99b8) 00000020:00000080:1.0:1788305933.518813:0:23475:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788305933.518906:0:23475:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8891bfab2000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788305933.518920:0:23475:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8891bfab2000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788305933.518923:0:23475:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8891bfab2000 3 00010000:00080000:1.0:1788305933.518955:0:23475:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8891bfa6a800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.155@tcp at head 00010000:00010000:1.0:1788305933.520520:0:23475:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788305933.520721:0:23475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788305933.520764:0:23475:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788305933.520777:0:23475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x4a426866e60550d4 00000100:00080000:1.0:1788305933.520788:0:23475:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788305933.520794:0:23475:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8891bfa6a800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305933.520830:0:23475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb23f100 x1875174015358336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305933.520861:0:23475:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788305933.520894:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305933.520898:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788305933.520906:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305933.520909:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788305933.531797:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875174015358336:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788305933.531890:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305933.532103:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015358336 00000100:00100000:0.0:1788305933.532112:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015358336 00000100:00100000:0.0:1788305933.532166:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788305933.532174:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015358336:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788305933.532199:0:22722:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 763 last 0 00000020:00000080:0.0:1788305933.532234:0:22722:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4a426866e60550db 00000004:00100000:0.0:1788305933.532248:0:22722:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788305933.532296:0:22722:0:(import.c:65:import_set_state_nolock()) ffff8891b8ec0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305933.532977:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875174015358336:12345-0@lo:38:llog_process_th.0 Request processed in 732us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305933.532987:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788305933.533033:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8891bb23f100 x1875174015358336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305933.533043:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788305933.533050:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788305933.533057:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788305933.533062:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788305933.533065:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bfa6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788305933.533070:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875174015358336:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788305933.533243:0:23475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:1.0:1788305933.534023:0:23455:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788305933.534054:0:23455:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788305933.534080:0:23455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e60550bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60550c6 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305933.534090:0:23455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e60550bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60550c6 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788305933.534139:0:23455:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788305933.534141:0:23455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788305933.534142:0:23455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305933.534144:0:23455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305933.534145:0:23455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305933.534155:0:23455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305933.534157:0:23455:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788305933.534159:0:23455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305933.534160:0:23455:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788305933.534164:0:23455:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788305933.534166:0:23455:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788305933.534167:0:23455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788305933.534169:0:23455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305933.534170:0:23455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305933.534171:0:23455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305933.534172:0:23455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305933.534173:0:23455:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788305933.534174:0:23455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305933.534175:0:23455:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788305933.534197:0:23455:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788305933.534213:0:23455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015358464:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788305933.534260:0:23455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305933.534621:0:23455:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a31f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788305933.538655:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015358464 00000100:00100000:0.0:1788305933.538752:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015358464 00000100:00100000:0.0:1788305933.538856:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788305933.538866:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:23455:x1875174015358464:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788305933.538900:0:22714:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788305933.538926:0:22714:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1788305933.545651:0:22702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788305933.545772:0:22714:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788305933.545791:0:22714:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788305933.546133:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:23455:x1875174015358464:12345-0@lo:253:mount.lustre.0 Request processed in 7265us (11868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305933.546145:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 20000000:01000000:2.0:1788305933.546220:0:22737:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788305933.546225:0:22737:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788305933.546243:0:22737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8891bb3ebe00/0x4a426866e60550e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.546259:0:22737:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891bb3ea000/0x4a426866e6054fe6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6054fdf expref: 17 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.546267:0:22737:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181683400/0x4a426866e60550aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60550a3 expref: 17 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.546301:0:22737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8891bb3ebe00/0x4a426866e60550e2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.546431:0:22737:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181683400/0x4a426866e60550aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60550a3 expref: 17 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.546446:0:22737:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889181683400/0x4a426866e60550aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60550a3 expref: 17 pid: 22714 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305933.546459:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9916a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22737:1875174015358592:0@lo:104: 00000100:00100000:2.0:1788305933.546505:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788305933.546548:0:22737:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891bb3ea000/0x4a426866e6054fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e6054fdf expref: 17 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.546556:0:22737:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8891bb3ea000/0x4a426866e6054fe6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e6054fdf expref: 17 pid: 22715 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305933.546564:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22737:1875174015358720:0@lo:104: 00000100:00100000:2.0:1788305933.546580:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305933.546595:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083caa540 going to sleep for 11 seconds 00000100:00100000:0.0:1788305933.546648:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015358592 00000100:00100000:0.0:1788305933.546655:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015358592 00000100:00100000:0.0:1788305933.546687:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015358720 00000100:00100000:0.0:1788305933.546690:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015358720 00000100:00100000:0.0:1788305933.546701:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788305933.546708:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+4:22737:x1875174015358592:12345-0@lo:104: 00010000:00010000:0.0:1788305933.546719:0:22706:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60550a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60550aa expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305933.546765:0:22706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788305933.546771:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+4:22737:x1875174015358592:12345-0@lo:104: Request processed in 64us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305933.546777:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788305933.546788:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788305933.546793:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9916d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+3:22737:x1875174015358720:12345-0@lo:104: 00010000:00010000:0.0:1788305933.546800:0:22706:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e6054fdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6054fe6 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305933.546825:0:22706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788305933.546835:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9916d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+3:22737:x1875174015358720:12345-0@lo:104: Request processed in 42us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305933.546841:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788305933.546997:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9916a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22737:1875174015358592:0@lo:104: 00000100:00100000:2.0:1788305933.547005:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22737:1875174015358720:0@lo:104: 00010000:00010000:2.0:1788305933.547022:0:22737:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8891bb3ebe00/0x4a426866e60550e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.547037:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305933.547042:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60550a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60550aa expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.547049:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523b200 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305933.547052:0:22710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60550a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60550aa expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.547061:0:22710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60550a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60550aa expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305933.547068:0:22710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60550a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60550aa expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305933.547073:0:22710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305933.547110:0:22710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60550a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60550aa expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.547117:0:22710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305933.547133:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60550a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60550aa expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.547140:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60550a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60550aa expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.547162:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305933.547165:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e6054fdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6054fe6 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.547170:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181683000 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305933.547173:0:22710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e6054fdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6054fe6 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.547180:0:22710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e6054fdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6054fe6 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305933.547186:0:22710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e6054fdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6054fe6 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305933.547191:0:22710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305933.547201:0:22710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e6054fdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054fe6 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.547207:0:22710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305933.547216:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e6054fdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054fe6 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.547231:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e6054fdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054fe6 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.547243:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305933.547245:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305933.547247:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305933.547407:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4402ecd-e8a2-4271-82d7-771a7bb97982:3650:1875174015358848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305933.547435:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788305933.547516:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305933.547528:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015358848 00000100:00100000:2.0:1788305933.547531:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015358848 00010000:00010000:2.0:1788305933.547547:0:22707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181683400/0x4a426866e60550aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60550a3 expref: 18 pid: 22714 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305933.547565:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788305933.547571:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9914a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:3650:x1875174015358848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788305933.547580:0:22707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305933.547585:0:22707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181683400/0x4a426866e60550aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60550a3 expref: 18 pid: 22714 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.547594:0:22707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181683400/0x4a426866e60550aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60550a3 expref: 18 pid: 22714 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.547606:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181683400/0x4a426866e60550aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60550a3 expref: 18 pid: 22714 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.547617:0:22707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305933.547638:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9914a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4402ecd-e8a2-4271-82d7-771a7bb97982+17:3650:x1875174015358848:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305933.547649:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788305933.547733:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4402ecd-e8a2-4271-82d7-771a7bb97982:3650:1875174015358848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788305933.547775:0:23455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:23455:1875174015358464:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788305933.547785:0:23455:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788305933.547788:0:23455:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788305933.547790:0:23455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788305933.547791:0:23455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788305933.547797:0:23455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788305933.547798:0:23455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788305933.547800:0:23455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788305933.547801:0:23455:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788305933.547803:0:23455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788305933.547805:0:23455:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788305933.547814:0:23455:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788305933.548641:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4402ecd-e8a2-4271-82d7-771a7bb97982:3647:1875174015358976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788305933.548812:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305933.548869:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015358976 00000100:00100000:3.0:1788305933.548873:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015358976 00010000:00010000:3.0:1788305933.548888:0:22708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891bb3ea000/0x4a426866e6054fe6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6054fdf expref: 17 pid: 22715 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305933.548997:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788305933.549006:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188563800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+17:3647:x1875174015358976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788305933.549015:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305933.549020:0:22708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891bb3ea000/0x4a426866e6054fe6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6054fdf expref: 17 pid: 22715 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.549030:0:22708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891bb3ea000/0x4a426866e6054fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e6054fdf expref: 17 pid: 22715 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.549043:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3ea000/0x4a426866e6054fe6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e6054fdf expref: 17 pid: 22715 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.549056:0:22708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8891bb3ebe00/0x4a426866e60550e2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.549064:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3ebe00/0x4a426866e60550e2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788305933.549076:0:22708:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009268575s 00010000:00010000:3.0:1788305933.549085:0:22708:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8891bb3ebe00/0x4a426866e60550e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.549092:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8891bb3ebe00/0x4a426866e60550e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.549100:0:22708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8891bb3ebe00/0x4a426866e60550e2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.549106:0:22708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8891bb3ebe00/0x4a426866e60550e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.549112:0:22708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebe00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305933.549116:0:22708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8891bb3ebe00/0x4a426866e60550e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.549123:0:22708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8891bb3ebe00/0x4a426866e60550e2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.549142:0:22708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8891bb3ebe00/0x4a426866e60550e2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305933.549158:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305933.549190:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188563800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+16:3647:x1875174015358976:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305933.549196:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788305933.549449:0:22737:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8891bb3ebe00/0x4a426866e60550e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.549458:0:22737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8891bb3ebe00/0x4a426866e60550e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305933.549464:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3ebe00/0x4a426866e60550e2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305933.550828:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4402ecd-e8a2-4271-82d7-771a7bb97982:3647:1875174015358976:0@lo:103:ldlm_bl.0 00000040:01000000:3.0:1788305933.552521:0:23455:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1788305933.552835:0:23482:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1788305933.553241:0:23482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788305933.553772:0:23455:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1788305933.554656:0:23483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23483:1875174015359104:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788305933.554809:0:23483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305933.554843:0:23483:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083caa780 going to sleep for 11 seconds 00000040:01000000:1.0:1788305933.555063:0:23455:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788305933.555099:0:23455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1788305933.555409:0:23481:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788305933.555414:0:23481:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788305933.555504:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015359104 00000100:00100000:2.0:1788305933.555511:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015359104 00000100:00100000:2.0:1788305933.555563:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788305933.555571:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23483:x1875174015359104:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788305933.555649:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23483:x1875174015359104:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 78us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305933.555656:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00000080:1.0:1788305933.556253:0:23455:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788305933.556264:0:23455:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:2.0:1788305933.556808:0:23483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23483:1875174015359104:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1788305933.556843:0:23483:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788305933.556881:0:23483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23483:1875174015359232:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788305933.557017:0:23455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788305933.557803:0:23483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305933.557847:0:23483:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083caa780 going to sleep for 11 seconds 00000100:00100000:0.0:1788305933.557956:0:23464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015359232 00000100:00100000:0.0:1788305933.557962:0:23464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015359232 00000100:00100000:0.0:1788305933.558012:0:23464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305933.558022:0:23464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23483:x1875174015359232:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788305933.558172:0:23464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23483:x1875174015359232:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 151us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305933.558179:0:23464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788305933.558452:0:23483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23483:1875174015359232:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788305933.558525:0:23483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23483:1875174015359360:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788305933.558555:0:23483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305933.558575:0:23483:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083caacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305933.559030:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015359360 00000100:00100000:2.0:1788305933.559035:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015359360 00000100:00100000:2.0:1788305933.559073:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788305933.559081:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23483:x1875174015359360:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788305933.559125:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23483:x1875174015359360:12345-0@lo:900:lod0001_rec0000.0 Request processed in 45us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305933.559132:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788305933.559175:0:23483:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8891b9917b80 x1875174015359360/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788305949 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305933.559186:0:23483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23483:1875174015359360:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788305933.559228:0:23483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23483:1875174015359488:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788305933.559253:0:23483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305933.559294:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015359488 00000100:00100000:2.0:1788305933.559298:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015359488 00000100:00100000:2.0:1788305933.560244:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788305933.560256:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23483:x1875174015359488:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788305933.560471:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23483:x1875174015359488:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 217us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305933.560479:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788305933.560500:0:23483:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083caa780 going to sleep for 11 seconds 00000100:00100000:2.0:1788305933.560517:0:23483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23483:1875174015359488:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788305933.560572:0:23483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788305933.562217:0:23455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788305933.563119:0:23482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788305933.563208:0:23482:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1788305933.565610:0:23483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788305933.565692:0:23483:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788305933.565697:0:23483:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:1.0:1788305933.566071:0:23455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788305933.566112:0:23455:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788305933.566245:0:23455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788305933.567420:0:23455:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:1.0:1788305933.569271:0:23455:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1788305933.582355:0:23455:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788305933.582396:0:23455:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff94a3c190f988 00100000:10000000:3.0:1788305933.582404:0:23455:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788305933.584852:0:23455:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788305933.584890:0:23455:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.155@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788305933.584908:0:23455:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788305933.585164:0:23455:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788305933.589040:0:23455:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788305933.589850:0:23455:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788305934.039437:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305934.485399:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0aec00 going to sleep for 0 seconds 00000040:00080000:3.0:1788305934.559749:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788305934.874684:0:22720:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788305934.874692:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8891bfab2000 from 12 10000000:01000000:3.0:1788305934.874695:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788305934.874737:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181683200/0x4a426866e60550e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305934.874748:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889181683200/0x4a426866e60550e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305934.874760:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889181683200/0x4a426866e60550e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305934.874785:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188562d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015359616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788305934.874852:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305934.874901:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af32cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305934.875111:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015359616 00000100:00100000:0.0:1788305934.875118:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015359616 00000100:00100000:0.0:1788305934.875177:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788305934.875186:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+16:22720:x1875174015359616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305934.875198:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305934.875209:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891a523be00/0x4a426866e60550f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60550e9 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305934.875228:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891a523be00/0x4a426866e60550f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60550e9 expref: 17 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305934.875237:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891a523be00/0x4a426866e60550f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60550e9 expref: 17 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305934.875245:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523be00, rc 0) 00000100:00100000:0.0:1788305934.875376:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+17:22720:x1875174015359616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305934.875399:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788305934.875447:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188562d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015359616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305934.875579:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889181683200/0x4a426866e60550e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60550f0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305934.875587:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889181683200/0x4a426866e60550e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60550f0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305934.875695:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015359744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788305934.875724:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305934.875747:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff889082568cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305934.875914:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015359744 00000100:00100000:3.0:1788305934.875919:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015359744 00000100:00100000:3.0:1788305934.875952:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788305934.875959:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+17:22720:x1875174015359744:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788305934.875982:0:22714:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788305934.875996:0:22714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788305934.875999:0:22714:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1788305934.876082:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+17:22720:x1875174015359744:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305934.876090:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788305934.876160:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015359744:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788305934.876203:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788305934.876209:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181683200/0x4a426866e60550e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60550f0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305934.876217:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889181683200/0x4a426866e60550e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60550f0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305934.876227:0:22720:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788305934.876229:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8891bbb3a800 from 12 10000000:01000000:1.0:1788305934.876232:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788305934.876249:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889180031a00/0x4a426866e60550f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305934.876256:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889180031a00/0x4a426866e60550f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305934.876264:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889180031a00/0x4a426866e60550f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305934.876378:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015359872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788305934.876404:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305934.876421:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cad50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305934.876538:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015359872 00000100:00100000:3.0:1788305934.876542:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015359872 00000100:00100000:3.0:1788305934.876569:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788305934.876574:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+17:22720:x1875174015359872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305934.876582:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305934.876590:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181682e00/0x4a426866e60550fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60550f7 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305934.876868:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181682e00/0x4a426866e60550fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60550f7 expref: 18 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305934.876879:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181682e00/0x4a426866e60550fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60550f7 expref: 18 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305934.876889:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181682e00, rc 0) 00000100:00100000:3.0:1788305934.876920:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:22720:x1875174015359872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 346us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305934.876926:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788305934.876992:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015359872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305934.877003:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889180031a00/0x4a426866e60550f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60550fe expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305934.877012:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889180031a00/0x4a426866e60550f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60550fe expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305934.877054:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015360000:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788305934.877079:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305934.877099:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cad50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305934.877133:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015360000 00000100:00100000:3.0:1788305934.877146:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015360000 00000100:00100000:3.0:1788305934.877172:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788305934.877177:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:22720:x1875174015360000:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788305934.877194:0:22716:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788305934.877204:0:22716:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788305934.877206:0:22716:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1788305934.877259:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:22720:x1875174015360000:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 81us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305934.877265:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788305934.877412:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015360000:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788305934.877444:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788305934.877449:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889180031a00/0x4a426866e60550f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60550fe expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305934.877456:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889180031a00/0x4a426866e60550f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60550fe expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305935.063363:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305935.509675:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0aec00 going to sleep for 0 seconds 00000040:00080000:1.0:1788305935.581027:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788305936.085555:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305936.533367:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0aec00 going to sleep for 0 seconds 00010000:00010000:3.0:1788305937.110112:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305937.559046:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0aec00 going to sleep for 0 seconds 00010000:00010000:3.0:1788305938.133694:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305938.393151:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305938.393185:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015360128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305938.393254:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305938.393317:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015360128 00000100:00100000:2.0:1788305938.393324:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015360128 00000100:00100000:2.0:1788305938.393368:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788305938.393377:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015360128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788305938.393409:0:22726:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788305938.393452:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015360128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305938.393459:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788305938.393503:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015360128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305938.585553:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0aec00 going to sleep for 0 seconds 00000100:00080000:1.0:1788305938.904558:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788305938.904564:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788305938.904567:0:36:0:(import.c:65:import_set_state_nolock()) ffff8891bb1ea800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305938.904584:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8891bb1ea800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305938.904607:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb23ea00 x1875174015360384/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305938.904624:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305938.904627:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788305938.904630:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305938.904633:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788305938.904645:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305938.904648:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788305938.904651:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305938.904654:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788305938.904732:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4402ecd-e8a2-4271-82d7-771a7bb97982:3649:1875174015360256:0@lo:400:kworker.0 00000100:00100000:1.0:1788305938.904791:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305938.904835:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305938.904840:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015360512:0@lo:400:kworker.0 00000100:00100000:1.0:1788305938.904874:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305938.904902:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015360384:0@lo:38:kworker.0 00000100:00100000:1.0:1788305938.904923:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305938.904945:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015360640:0@lo:400:kworker.0 00000100:00100000:1.0:1788305938.904978:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305938.905008:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015360256 00000100:00100000:1.0:1788305938.905013:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015360256 00000100:00100000:1.0:1788305938.905049:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788305938.905062:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:3649:x1875174015360256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305938.905112:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:3649:x1875174015360256:12345-0@lo:400:kworker.0 Request processed in 50us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305938.905118:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788305938.908207:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015360512 00000100:00100000:1.0:1788305938.908221:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015360512 00000100:00100000:1.0:1788305938.908291:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015360640 00000100:00100000:1.0:1788305938.908294:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015360640 00000100:00100000:1.0:1788305938.908313:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788305938.908322:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015360512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305938.908420:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015360512:12345-0@lo:400:kworker.0 Request processed in 84us (3530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305938.908428:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788305938.908446:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788305938.908453:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015360640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305938.908487:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015360640:12345-0@lo:400:kworker.0 Request processed in 35us (3509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305938.908493:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788305938.908512:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015360384 00000100:00100000:1.0:1788305938.908516:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015360384 00000100:00100000:1.0:1788305938.908534:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788305938.908539:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875174015360384:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788305938.908563:0:22727:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 768 last 0 00000020:00000080:1.0:1788305938.908600:0:22727:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4a426866e6055105 00000004:00100000:1.0:1788305938.908616:0:22727:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788305938.908621:0:22727:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:1.0:1788305938.908739:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891bb23f480 x1875174015360640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305938.908753:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015360640:0@lo:400:kworker.0 00010000:00080000:1.0:1788305938.908788:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891bb23e680 x1875174015360512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305938.908797:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015360512:0@lo:400:kworker.0 00000100:00100000:1.0:1788305938.908808:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4402ecd-e8a2-4271-82d7-771a7bb97982:3649:1875174015360256:0@lo:400:kworker.0 00000100:00080000:2.0:1788305938.929272:0:22727:0:(import.c:65:import_set_state_nolock()) ffff88908273a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305938.929410:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875174015360384:12345-0@lo:38:kworker.0 Request processed in 20867us (24483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305938.929421:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788305938.931138:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788305938.931152:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788305938.931160:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788305938.931163:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bb1ea800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788305938.931226:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008a6dc13d): req@ffff8891b9914000 x1875174015352960/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305938.931250:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015360384:0@lo:38:kworker.0 00000100:00100000:3.0:1788305938.933777:0:22763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305938.933822:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0aec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305938.933885:0:23464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015352960 00000100:00100000:1.0:1788305938.933892:0:23464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015352960 00000100:00100000:1.0:1788305938.933945:0:23464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305938.933962:0:23464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22763:x1875174015352960:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788305938.934040:0:23464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22763:x1875174015352960:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 86us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305938.934048:0:23464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305938.934084:0:22763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9914000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22763:1875174015352960:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788305938.934130:0:22763:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788305938.934178:0:22763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22763:1875174015360768:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788305938.934209:0:22763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305938.934225:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cad5780 going to sleep for 11 seconds 00000100:00100000:1.0:1788305938.934238:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015360768 00000100:00100000:1.0:1788305938.934241:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015360768 00000100:00100000:1.0:1788305938.934260:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788305938.934266:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22763:x1875174015360768:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788305938.934393:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22763:x1875174015360768:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 126us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305938.934401:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788305938.934429:0:22763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22763:1875174015360768:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788305938.934492:0:22763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22763:1875174015360896:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788305938.934514:0:22763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305938.934527:0:22763:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cad5780 going to sleep for 11 seconds 00000100:00100000:1.0:1788305938.934537:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015360896 00000100:00100000:1.0:1788305938.934540:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015360896 00000100:00100000:1.0:1788305938.934558:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788305938.934563:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22763:x1875174015360896:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788305938.937541:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22763:x1875174015360896:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 2969us (3017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305938.937553:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788305938.937631:0:22763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22763:1875174015360896:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788305938.937704:0:22763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788305938.942255:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015361024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305938.942348:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305938.942514:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015361024 00000100:00100000:2.0:1788305938.942522:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015361024 00000100:00100000:2.0:1788305938.942584:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788305938.942594:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875174015361024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788305938.942630:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788305938.942688:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875174015361024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305938.942696:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788305938.942742:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015361024:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788305938.943850:0:22763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788305938.944004:0:22763:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:1.0:1788305938.944010:0:22763:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:2.0:1788305939.088503:0:23726:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788305939.159485:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788305940.047067:0:23778:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788305940.047633:0:23778:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788305940.186455:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788305940.570776:0:22756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788305941.209256:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788305941.216421:0:23828:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788305941.216646:0:23828:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788305942.235118:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788305942.438757:0:23877:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd5ae09d10 20000000:00000080:1.0:1788305942.438785:0:23877:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8891c06d4c00 uarg=0000000000000000 20000000:01000000:1.0:1788305942.438847:0:23877:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788305942.438857:0:23877:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788305942.438864:0:23877:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788305942.443638:0:23878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1788305942.444010:0:23877:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788305942.453752:0:23877:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788305942.453909:0:23877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8891bb3eba00/0x4a426866e605510c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.453936:0:23877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891bb3ebc00/0x4a426866e6054fb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6054fae expref: 17 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.453945:0:23877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891a523a800/0x4a426866e60550b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60550b1 expref: 17 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.453954:0:23877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8891bb3eba00/0x4a426866e605510c lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.454018:0:23877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891a523a800/0x4a426866e60550b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60550b1 expref: 17 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.454038:0:23877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8891a523a800/0x4a426866e60550b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60550b1 expref: 17 pid: 22716 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305942.454056:0:23877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23877:1875174015361152:0@lo:104: 00000100:00100000:2.0:1788305942.454162:0:23877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788305942.454241:0:23877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891bb3ebc00/0x4a426866e6054fb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e6054fae expref: 17 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.454299:0:23877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8891bb3ebc00/0x4a426866e6054fb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e6054fae expref: 17 pid: 22714 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305942.454310:0:23877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9915880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23877:1875174015361280:0@lo:104: 00000100:00100000:2.0:1788305942.454336:0:23877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305942.454371:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015361152 00000100:00100000:2.0:1788305942.454380:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015361152 00000100:00100000:2.0:1788305942.454448:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015361280 00000100:00100000:2.0:1788305942.454452:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015361280 00000100:00100000:2.0:1788305942.454472:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788305942.454482:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9915c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+4:23877:x1875174015361152:12345-0@lo:104: 00010000:00010000:2.0:1788305942.454498:0:22706:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e60550b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60550b8 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.454878:0:22706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788305942.454896:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9915c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+4:23877:x1875174015361152:12345-0@lo:104: Request processed in 405us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305942.454905:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788305942.454929:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788305942.454936:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9916300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+3:23877:x1875174015361280:12345-0@lo:104: 00010000:00010000:2.0:1788305942.454945:0:22706:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889180030a00/0x4a426866e6054fae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6054fb5 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.454984:0:22706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788305942.454989:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9916300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+3:23877:x1875174015361280:12345-0@lo:104: Request processed in 55us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305942.454995:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788305942.455026:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305942.455032:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e60550b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60550b8 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.455040:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb000 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305942.455045:0:22711:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e60550b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60550b8 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.455054:0:22711:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e60550b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60550b8 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305942.455063:0:22711:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e60550b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60550b8 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305942.455078:0:22711:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788305942.455114:0:22711:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e60550b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60550b8 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.455121:0:22711:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305942.455143:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e60550b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60550b8 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.455150:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e60550b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60550b8 expref: -99 pid: 23455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.455165:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305942.455168:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889180030a00/0x4a426866e6054fae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6054fb5 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.455173:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889180030a00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305942.455176:0:22711:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889180030a00/0x4a426866e6054fae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6054fb5 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.455188:0:22711:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889180030a00/0x4a426866e6054fae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6054fb5 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305942.455195:0:22711:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889180030a00/0x4a426866e6054fae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6054fb5 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305942.455200:0:22711:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788305942.455213:0:22711:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889180030a00/0x4a426866e6054fae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054fb5 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.455219:0:22711:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305942.455224:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889180030a00/0x4a426866e6054fae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054fb5 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.455231:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889180030a00/0x4a426866e6054fae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054fb5 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.455246:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305942.455248:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305942.455250:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305942.455268:0:23877:0:(client.c:2715:ptlrpc_set_wait()) set ffff889187ef40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305942.455325:0:23877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23877:1875174015361152:0@lo:104: 00000100:00100000:2.0:1788305942.455335:0:23877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9915880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23877:1875174015361280:0@lo:104: 00010000:00010000:2.0:1788305942.455363:0:23877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8891bb3eba00/0x4a426866e605510c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305942.456221:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305942.456679:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4402ecd-e8a2-4271-82d7-771a7bb97982:3649:1875174015361408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305942.456764:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305942.456822:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305942.456840:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4402ecd-e8a2-4271-82d7-771a7bb97982:3649:1875174015361536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305942.456874:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305942.457571:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015361408 00000100:00100000:3.0:1788305942.457582:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015361408 00010000:00010000:3.0:1788305942.457632:0:22707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891a523a800/0x4a426866e60550b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60550b1 expref: 18 pid: 22716 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305942.457674:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015361536 00000100:00100000:3.0:1788305942.457678:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015361536 00010000:00010000:3.0:1788305942.457712:0:22707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891bb3ebc00/0x4a426866e6054fb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6054fae expref: 19 pid: 22714 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305942.457728:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788305942.457739:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4402ecd-e8a2-4271-82d7-771a7bb97982+19:3649:x1875174015361408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788305942.457755:0:22707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305942.457761:0:22707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891a523a800/0x4a426866e60550b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60550b1 expref: 19 pid: 22716 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305942.457776:0:22707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891a523a800/0x4a426866e60550b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60550b1 expref: 19 pid: 22716 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305942.457798:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891a523a800/0x4a426866e60550b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60550b1 expref: 19 pid: 22716 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305942.457817:0:22707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305942.458314:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:3649:x1875174015361408:12345-0@lo:103:ldlm_bl.0 Request processed in 537us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305942.458324:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788305942.458418:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788305942.458699:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4402ecd-e8a2-4271-82d7-771a7bb97982+17:3649:x1875174015361536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788305942.458728:0:22707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305942.458735:0:22707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891bb3ebc00/0x4a426866e6054fb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6054fae expref: 17 pid: 22714 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.458748:0:22707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891bb3ebc00/0x4a426866e6054fb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e6054fae expref: 17 pid: 22714 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.458762:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3ebc00/0x4a426866e6054fb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e6054fae expref: 17 pid: 22714 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.458778:0:22707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8891bb3eba00/0x4a426866e605510c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.458787:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3eba00/0x4a426866e605510c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.458805:0:22707:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8891bb3eba00/0x4a426866e605510c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.458814:0:22707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8891bb3eba00/0x4a426866e605510c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.458822:0:22707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8891bb3eba00/0x4a426866e605510c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305942.459359:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4402ecd-e8a2-4271-82d7-771a7bb97982:3649:1875174015361408:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788305942.459480:0:22707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8891bb3eba00/0x4a426866e605510c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.459487:0:22707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eba00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305942.459493:0:22707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8891bb3eba00/0x4a426866e605510c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.459516:0:22707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8891bb3eba00/0x4a426866e605510c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.459535:0:22707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8891bb3eba00/0x4a426866e605510c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305942.459623:0:22707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305942.459698:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4402ecd-e8a2-4271-82d7-771a7bb97982+16:3649:x1875174015361536:12345-0@lo:103:ldlm_bl.0 Request processed in 1272us (2832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305942.459707:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788305942.460305:0:23877:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8891bb3eba00/0x4a426866e605510c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305942.460319:0:23877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8891bb3eba00/0x4a426866e605510c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305942.460327:0:23877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3eba00/0x4a426866e605510c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305942.465322:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4402ecd-e8a2-4271-82d7-771a7bb97982:3649:1875174015361536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305942.997604:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305927/real 1788305927] req@ffff8891bb23f800 x1875174015353984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305942 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305942.997651:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8891bb23f800 x1875174015353984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305942 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305942.997663:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305927/real 1788305927] req@ffff8891bb23d180 x1875174015354112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305942 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305942.997676:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8891bb23d180 x1875174015354112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305942 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788305942.997705:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bb1ed800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305942.997732:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788305942.997738:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015353984:0@lo:8:kworker.0 00000100:00080000:1.0:1788305942.997773:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908353f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305942.997781:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788305942.997785:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015354112:0@lo:8:kworker.0 00000100:00080000:0.0:1788305942.998028:0:21146:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305942.998038:0:21146:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788305942.998042:0:21146:0:(import.c:65:import_set_state_nolock()) ffff8891bb1ed800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788305942.998048:0:21146:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 757 00000100:00080000:0.0:1788305942.998154:0:21146:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788305942.998165:0:21146:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8891bb1ed800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305942.998597:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4402ecd-e8a2-4271-82d7-771a7bb97982:3647:1875174015361664:0@lo:400:kworker.0 00000100:00100000:0.0:1788305942.999103:0:21146:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891afb37100 x1875174015361920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788305942.999493:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015361792:0@lo:400:kworker.0 00000100:00100000:3.0:1788305942.999571:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305942.999653:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015361792 00000100:00100000:3.0:1788305942.999663:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015361792 00000100:00100000:3.0:1788305942.999724:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788305942.999736:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875174015361792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305942.999803:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875174015361792:12345-0@lo:400:kworker.0 Request processed in 68us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305942.999811:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788305942.999873:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015361792:0@lo:400:kworker.0 00000100:00080000:0.0:1788305943.001020:0:21146:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305943.001025:0:21146:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788305943.001029:0:21146:0:(import.c:65:import_set_state_nolock()) ffff88908353f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788305943.001035:0:21146:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 757 00000100:00080000:0.0:1788305943.001039:0:21146:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788305943.001045:0:21146:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88908353f000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788305943.001122:0:21146:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891afb37800 x1875174015362048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788305943.001171:0:21146:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305943.001174:0:21146:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788305943.001178:0:21146:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305943.001181:0:21146:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788305943.001466:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305943.001705:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015361920:0@lo:8:kworker.0 00000400:00000100:1.0:1788305943.001768:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875174015361920 offset 0 length 520: 4 00000100:00100000:1.0:1788305943.001791:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015362048:0@lo:8:kworker.0 00000400:00000100:1.0:1788305943.001810:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875174015362048 offset 0 length 520: 4 00000100:00100000:0.0:1788305943.004206:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015361664 00000100:00100000:0.0:1788305943.004220:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015361664 00000100:00100000:1.0:1788305943.004539:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015362304:0@lo:400:kworker.0 00000100:00100000:1.0:1788305943.004634:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305943.004695:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305943.004703:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015362176:0@lo:400:kworker.0 00000100:00100000:1.0:1788305943.004733:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305943.004776:0:23464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015362304 00000100:00100000:1.0:1788305943.004781:0:23464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015362304 00000100:00100000:1.0:1788305943.004850:0:23464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788305943.004862:0:23464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015362304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305943.005261:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305943.006584:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788305943.006610:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+16:3647:x1875174015361664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305943.006726:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+16:3647:x1875174015361664:12345-0@lo:400:kworker.0 Request processed in 129us (5260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305943.006735:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788305943.007102:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4402ecd-e8a2-4271-82d7-771a7bb97982:3647:1875174015361664:0@lo:400:kworker.0 00000100:00100000:1.0:1788305943.012332:0:23464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015362304:12345-0@lo:400:kworker.0 Request processed in 7455us (7682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305943.012357:0:23464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788305943.012455:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015362304:0@lo:400:kworker.0 00000100:00100000:3.0:1788305943.012707:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015362432:0@lo:400:kworker.0 00000100:00100000:3.0:1788305943.012774:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305943.013359:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015362176 00000100:00100000:0.0:1788305943.013391:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015362176 00000100:00100000:0.0:1788305943.013446:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015362432 00000100:00100000:0.0:1788305943.013449:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015362432 00000100:00100000:0.0:1788305943.013468:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788305943.013480:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015362176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305943.013557:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015362176:12345-0@lo:400:kworker.0 Request processed in 80us (8822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305943.013566:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788305943.013582:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788305943.013588:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015362432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305943.013623:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015362432:12345-0@lo:400:kworker.0 Request processed in 35us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305943.013630:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788305943.013674:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891afb34700 x1875174015362176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305943.013689:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015362176:0@lo:400:kworker.0 00010000:00080000:0.0:1788305943.013719:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891afb35500 x1875174015362432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305943.013728:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015362432:0@lo:400:kworker.0 00010000:00010000:0.0:1788305943.254091:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305943.514926:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015362560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305943.515053:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305943.515329:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015362560 00000100:00100000:2.0:1788305943.515340:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015362560 00000100:00100000:2.0:1788305943.515418:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788305943.515430:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015362560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788305943.515475:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788305943.515534:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015362560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305943.515542:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788305943.515679:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015362560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788305944.021695:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305933/real 1788305933] req@ffff8891b9914700 x1875174015356544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305943 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305944.021732:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8891b9914700 x1875174015356544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305943 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305944.021774:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305933/real 1788305933] req@ffff8891b9917100 x1875174015356416/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305943 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305944.021789:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8891b9917100 x1875174015356416/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305943 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788305944.021809:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908273d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305944.021850:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788305944.021855:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015356544:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788305944.021860:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889183841800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305944.021865:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788305944.021869:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015356416:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788305944.022122:0:21146:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305944.022127:0:21146:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788305944.022130:0:21146:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305944.022133:0:21146:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788305944.022177:0:21146:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305944.022181:0:21146:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788305944.022184:0:21146:0:(import.c:65:import_set_state_nolock()) ffff889183841800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788305944.022189:0:21146:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 763 00000100:00080000:0.0:1788305944.022194:0:21146:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788305944.022200:0:21146:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff889183841800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788305944.022219:0:21146:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891afb37b80 x1875174015363200/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788305944.022230:0:21146:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305944.022232:0:21146:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788305944.022234:0:21146:0:(import.c:65:import_set_state_nolock()) ffff88908273d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788305944.022237:0:21146:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 763 00000100:00080000:0.0:1788305944.022239:0:21146:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788305944.022242:0:21146:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff88908273d800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788305944.022253:0:21146:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891afb34000 x1875174015363328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788305944.022359:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015363200:0@lo:8:kworker.0 00000400:00000100:1.0:1788305944.022548:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875174015363200 offset 0 length 520: 4 00000100:00100000:1.0:1788305944.022585:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015363328:0@lo:8:kworker.0 00000400:00000100:1.0:1788305944.022606:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875174015363328 offset 0 length 520: 4 00000100:00100000:2.0:1788305944.023041:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4402ecd-e8a2-4271-82d7-771a7bb97982:3649:1875174015362688:0@lo:400:kworker.0 00000100:00100000:2.0:1788305944.023093:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305944.023112:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015363456:0@lo:400:kworker.0 00000100:00100000:2.0:1788305944.023137:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305944.023184:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305944.023191:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015362816:0@lo:400:kworker.0 00000100:00100000:2.0:1788305944.023216:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305944.023242:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015362944:0@lo:400:kworker.0 00000100:00100000:2.0:1788305944.023263:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305944.023297:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305944.023303:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015363072:0@lo:400:kworker.0 00000100:00100000:2.0:1788305944.023324:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305944.023353:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015362816 00000100:00100000:2.0:1788305944.023360:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015362816 00000100:00100000:3.0:1788305944.023790:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015363456 00000100:00100000:3.0:1788305944.023795:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015363456 00000100:00100000:3.0:1788305944.023827:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015362944 00000100:00100000:3.0:1788305944.023830:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015362944 00000100:00100000:3.0:1788305944.023846:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788305944.023854:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015363456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305944.024118:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015363072 00000100:00100000:2.0:1788305944.024123:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015363072 00000100:00100000:2.0:1788305944.024143:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788305944.024149:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875174015362816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305944.024231:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875174015362816:12345-0@lo:400:kworker.0 Request processed in 82us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305944.024239:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788305944.024266:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788305944.024272:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015363072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305944.024329:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015363072:12345-0@lo:400:kworker.0 Request processed in 58us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305944.024336:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788305944.024373:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015363072:0@lo:400:kworker.0 00000100:00100000:0.0:1788305944.024870:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015362688 00000100:00100000:0.0:1788305944.024877:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015362688 00000100:00100000:0.0:1788305944.024920:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788305944.024929:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb34ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+16:3649:x1875174015362688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305944.024976:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015362816:0@lo:400:kworker.0 00000100:00100000:2.0:1788305944.025032:0:22723:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788305944.025040:0:22723:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788305944.025305:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305944.025316:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015363584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788305944.039365:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb34ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+16:3649:x1875174015362688:12345-0@lo:400:kworker.0 Request processed in 14427us (16260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305944.039382:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788305944.039632:0:22721:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788305944.039644:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305944.039677:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015362944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305944.039749:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015362944:12345-0@lo:400:kworker.0 Request processed in 79us (16485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305944.039756:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788305944.039880:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891afb36a00 x1875174015362944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305944.039905:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015362944:0@lo:400:kworker.0 00000100:00100000:1.0:1788305944.042143:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305944.042215:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4402ecd-e8a2-4271-82d7-771a7bb97982:3649:1875174015362688:0@lo:400:kworker.0 00000100:00100000:3.0:1788305944.042619:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015363456:12345-0@lo:400:kworker.0 Request processed in 18763us (19478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305944.042630:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305944.042791:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015363584 00000100:00100000:0.0:1788305944.042800:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015363584 00000100:00100000:0.0:1788305944.042849:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788305944.042857:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875174015363584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788305944.043077:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788305944.043126:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875174015363584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 268us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305944.043132:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788305944.043264:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015363584:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1788305944.043305:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891afb35f80 x1875174015363456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305944.043335:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015363456:0@lo:400:kworker.0 00010000:00010000:0.0:1788305944.279216:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788305944.407210:0:22720:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788305944.407222:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8891bfab2000 from 13 10000000:01000000:2.0:1788305944.407230:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788305944.407350:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6055113 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305944.407375:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6055113 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305944.407391:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6055113 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305944.407428:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015363712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788305944.407544:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305944.407602:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891863e3000 going to sleep for 11 seconds 00000100:00100000:1.0:1788305944.407973:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015363712 00000100:00100000:1.0:1788305944.407987:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015363712 00000100:00100000:1.0:1788305944.408072:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788305944.408082:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb34a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+16:22720:x1875174015363712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305944.408099:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305944.408120:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88919d7dec00/0x4a426866e605511a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6055113 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305944.408148:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88919d7dec00/0x4a426866e605511a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6055113 expref: 17 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305944.408159:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88919d7dec00/0x4a426866e605511a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6055113 expref: 17 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305944.408171:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88919d7dec00, rc 0) 00000100:00100000:1.0:1788305944.408264:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb34a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+17:22720:x1875174015363712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305944.408271:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788305944.408619:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015363712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305944.408651:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6055113 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605511a expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305944.408666:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6055113 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e605511a expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305944.408800:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015363840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305944.409482:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305944.409615:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891863e3000 going to sleep for 11 seconds 00000100:00100000:1.0:1788305944.411600:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015363840 00000100:00100000:1.0:1788305944.411616:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015363840 00000100:00100000:1.0:1788305944.411677:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788305944.411686:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb348c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+17:22720:x1875174015363840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305944.411957:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb348c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+17:22720:x1875174015363840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 270us (2476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305944.411965:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788305944.415752:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015363840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305944.420946:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015363968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305944.421178:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305944.421867:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0ae600 going to sleep for 11 seconds 00000100:00100000:1.0:1788305944.436520:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015363968 00000100:00100000:1.0:1788305944.436538:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015363968 00000100:00100000:1.0:1788305944.436600:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788305944.436612:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb34a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+17:22720:x1875174015363968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305944.436782:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb34a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+17:22720:x1875174015363968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (15603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305944.436790:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788305944.437551:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015363968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788305944.441078:0:23951:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788305944.446190:0:22720:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788305944.446237:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788305944.446249:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6055113 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605511a expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305944.446262:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6055113 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605511a expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305944.446297:0:22720:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788305944.446301:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8891bbb3a800 from 13 10000000:01000000:1.0:1788305944.446303:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788305944.446343:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff88919d7de600/0x4a426866e6055121 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305944.446350:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff88919d7de600/0x4a426866e6055121 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305944.446361:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff88919d7de600/0x4a426866e6055121 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305944.446386:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015364096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788305944.446466:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305944.446515:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af30c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788305944.446719:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015364096 00000100:00100000:0.0:1788305944.446728:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015364096 00000100:00100000:0.0:1788305944.446773:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788305944.446782:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb348850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+17:22720:x1875174015364096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305944.446795:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305944.446808:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891a523ae00/0x4a426866e6055128 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6055121 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305944.446831:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891a523ae00/0x4a426866e6055128 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6055121 expref: 18 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305944.446851:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891a523ae00/0x4a426866e6055128 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6055121 expref: 18 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305944.446860:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523ae00, rc 0) 00000100:00100000:0.0:1788305944.446908:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb348850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:22720:x1875174015364096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305944.446914:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788305944.446986:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015364096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305944.447000:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff88919d7de600/0x4a426866e6055121 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055128 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305944.447019:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff88919d7de600/0x4a426866e6055121 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6055128 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305944.447085:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015364224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305944.447113:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305944.447140:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0ae480 going to sleep for 11 seconds 00000100:00100000:0.0:1788305944.447181:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015364224 00000100:00100000:0.0:1788305944.447185:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015364224 00000100:00100000:0.0:1788305944.447216:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788305944.447223:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbaab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:22720:x1875174015364224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305944.447357:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbaab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:22720:x1875174015364224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305944.447364:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788305944.447443:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015364224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305944.447472:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015364352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305944.447511:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305944.447536:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0ae480 going to sleep for 11 seconds 00000100:00100000:0.0:1788305944.447628:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015364352 00000100:00100000:0.0:1788305944.447632:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015364352 00000100:00100000:0.0:1788305944.447671:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788305944.447678:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889190efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:22720:x1875174015364352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305944.447759:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889190efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:22720:x1875174015364352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305944.447766:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788305944.448034:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015364352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788305944.453223:0:23952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788305944.453594:0:22720:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788305944.453623:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788305944.453636:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff88919d7de600/0x4a426866e6055121 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055128 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305944.453647:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff88919d7de600/0x4a426866e6055121 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055128 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1788305945.053004:0:23456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788305945.304160:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788305945.817590:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788305946.326073:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305947.349701:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305948.375099:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305948.631078:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015364480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305948.631149:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305948.631321:0:23464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015364480 00000100:00100000:1.0:1788305948.631329:0:23464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015364480 00000100:00100000:1.0:1788305948.631384:0:23464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788305948.631393:0:23464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015364480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788305948.631426:0:23464:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788305948.631475:0:23464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015364480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305948.631482:0:23464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788305948.631524:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015364480:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788305949.141467:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305949.141474:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788305949.141594:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4402ecd-e8a2-4271-82d7-771a7bb97982:3648:1875174015364608:0@lo:400:kworker.0 00000100:00100000:3.0:1788305949.141672:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305949.141752:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015364608 00000100:00100000:3.0:1788305949.141760:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015364608 00000100:00100000:3.0:1788305949.141802:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788305949.141811:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:3648:x1875174015364608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305949.141854:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:3648:x1875174015364608:12345-0@lo:400:kworker.0 Request processed in 44us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305949.141861:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788305949.141904:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4402ecd-e8a2-4271-82d7-771a7bb97982:3648:1875174015364608:0@lo:400:kworker.0 00000100:00080000:0.0:1788305949.141943:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305949.141948:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788305949.141976:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305949.141979:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788305949.141982:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305949.141985:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788305949.142018:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015364992:0@lo:400:kworker.0 00000100:00100000:0.0:1788305949.142050:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305949.142072:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788305949.142077:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015365120:0@lo:400:kworker.0 00000100:00100000:0.0:1788305949.142099:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305949.142119:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015364736:0@lo:400:kworker.0 00000100:00100000:0.0:1788305949.142138:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305949.142156:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305949.142160:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015364864:0@lo:400:kworker.0 00000100:00100000:0.0:1788305949.142182:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305949.142208:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015364992 00000100:00100000:0.0:1788305949.142212:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015364992 00000100:00100000:0.0:1788305949.142237:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015364736 00000100:00100000:0.0:1788305949.142240:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015364736 00000100:00100000:0.0:1788305949.142252:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788305949.142259:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015364992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305949.142333:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015364992:12345-0@lo:400:kworker.0 Request processed in 74us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305949.142350:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788305949.142365:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788305949.142371:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015364736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305949.142407:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015364736:12345-0@lo:400:kworker.0 Request processed in 36us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305949.142414:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788305949.142431:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015365120 00000100:00100000:0.0:1788305949.142434:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015365120 00000100:00100000:0.0:1788305949.142453:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015364864 00000100:00100000:0.0:1788305949.142455:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015364864 00000100:00100000:0.0:1788305949.142468:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788305949.142473:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015365120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305949.142650:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015365120:12345-0@lo:400:kworker.0 Request processed in 175us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305949.142656:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788305949.142668:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788305949.142673:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015364864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305949.142694:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015364864:12345-0@lo:400:kworker.0 Request processed in 21us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305949.142699:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788305949.142733:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891afb36d80 x1875174015364864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305949.142744:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015364864:0@lo:400:kworker.0 00000100:00100000:0.0:1788305949.142755:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015364736:0@lo:400:kworker.0 00010000:00080000:0.0:1788305949.142791:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891afb35180 x1875174015365120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305949.142808:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015365120:0@lo:400:kworker.0 00000100:00100000:0.0:1788305949.142819:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015364992:0@lo:400:kworker.0 00000100:00100000:0.0:1788305949.144796:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015365248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788305949.144865:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305949.145046:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015365248 00000100:00100000:1.0:1788305949.145055:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015365248 00000100:00100000:1.0:1788305949.145110:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788305949.145120:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015365248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788305949.145153:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788305949.145206:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015365248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305949.145214:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788305949.145260:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015365248:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788305949.406979:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788305950.078768:0:24226:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788305950.078772:0:24226:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788305950.078773:0:24226:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788305950.078883:0:24226:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff889182aee000 00000020:01000004:0.0:1788305950.078898:0:24226:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788305950.078912:0:24226:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788305950.078925:0:24226:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8891840299b8) 00000020:00000080:0.0:1788305950.078941:0:24226:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788305950.168670:0:24226:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788305950.174253:0:24226:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788305950.175270:0:24226:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788305950.176054:0:24226:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788305950.178247:0:24226:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788305950.181128:0:24226:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788305950.181743:0:24226:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1788305950.201894:0:24226:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788305950.202204:0:24226:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788305950.202223:0:24226:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788305950.202241:0:24226:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4a426866e6055136 00000020:01000004:1.0:1788305950.202250:0:24226:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788305950.202323:0:24226:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.155@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788305950.202328:0:24226:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788305950.202350:0:24226:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788305950.202357:0:24226:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788305950.202374:0:24226:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff889186788000) 00000020:00000080:1.0:1788305950.202390:0:24226:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1788305950.213421:0:24226:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788305950.215163:0:24226:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788305950.215170:0:24226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788305950.223097:0:24226:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788305950.223114:0:24226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788305950.223781:0:24226:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788305950.223800:0:24226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788305950.237794:0:24226:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788305950.237992:0:24226:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788305950.238010:0:24226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788305950.251666:0:24226:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788305950.251688:0:24226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788305950.297124:0:24226:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305950.297596:0:24226:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788305950.297604:0:24226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788305950.306872:0:24226:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788305950.306890:0:24226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788305950.311862:0:24226:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788305950.311879:0:24226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788305950.314808:0:24226:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788305950.315030:0:24226:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788305950.315042:0:24226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788305950.320891:0:24226:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788305950.320906:0:24226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788305950.399844:0:24226:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305950.401366:0:24226:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788305950.401377:0:24226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788305950.403535:0:24226:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788305950.403545:0:24226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788305950.404088:0:24226:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788305950.404121:0:24226:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788305950.404128:0:24226:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.155@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788305950.416123:0:24226:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.155@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788305950.416230:0:24226:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.155@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788305950.416235:0:24226:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788305950.416241:0:24226:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788305950.416242:0:24226:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305950.416244:0:24226:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305950.416245:0:24226:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305950.416246:0:24226:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305950.416247:0:24226:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788305950.416249:0:24226:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305950.416250:0:24226:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788305950.416254:0:24226:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788305950.416256:0:24226:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788305950.416258:0:24226:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788305950.416259:0:24226:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305950.416260:0:24226:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305950.416261:0:24226:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305950.416262:0:24226:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305950.416263:0:24226:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788305950.416264:0:24226:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305950.416265:0:24226:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788305950.416456:0:24226:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788305950.416477:0:24226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015365376:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788305950.416547:0:24226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305950.416598:0:24226:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891c0fbf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305950.416768:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015365376 00000100:00100000:2.0:1788305950.416775:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015365376 00000100:00100000:2.0:1788305950.416844:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788305950.416853:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:24226:x1875174015365376:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788305950.416882:0:22716:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788305950.416885:0:22716:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788305950.416890:0:22716:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788305950.417573:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:24226:x1875174015365376:12345-0@lo:253:mount.lustre.0 Request processed in 718us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305950.417583:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788305950.417647:0:24226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015365376:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788305950.417658:0:24226:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788305950.417660:0:24226:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788305950.417662:0:24226:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788305950.417663:0:24226:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305950.417664:0:24226:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305950.417665:0:24226:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305950.417667:0:24226:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305950.417668:0:24226:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788305950.417734:0:24226:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305950.417735:0:24226:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788305950.417753:0:24226:0:(tgt_mount.c:101:server_register_mount()) register mount ffff889182aee000 from lustre-OST0000 10000000:01000000:0.0:1788305950.417799:0:24226:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788305950.417802:0:24226:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788305950.417809:0:24226:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff889184028000 local copy 00010000:00010000:0.0:1788305950.417822:0:24226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054ef1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054ef8 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305950.417913:0:24226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015365504:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305950.417941:0:24226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305950.417973:0:24226:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891c0fbfa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788305950.418080:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015365504 00000100:00100000:3.0:1788305950.418085:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015365504 00000100:00100000:3.0:1788305950.418116:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788305950.418124:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:24226:x1875174015365504:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305950.418540:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:24226:x1875174015365504:12345-0@lo:501:mount.lustre.0 Request processed in 416us (596us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788305950.418547:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788305950.418597:0:24226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015365504:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788305950.418616:0:24226:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788305950.418635:0:24226:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788305950.418641:0:24226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054ef1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054ef8 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305950.418650:0:24226:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054ef1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054ef8 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305950.418742:0:24226:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff889182aee000 10000000:01000000:2.0:1788305950.418748:0:24226:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788305950.418803:0:24226:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788305950.418807:0:24226:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788305950.418812:0:24226:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788305950.418816:0:24226:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788305950.418842:0:24226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6055144 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305950.418850:0:24226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6055144 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305950.418859:0:24226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6055144 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305950.418873:0:24226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015365632:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788305950.418901:0:24226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305950.418970:0:24226:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb56300 going to sleep for 11 seconds 00000100:00100000:1.0:1788305950.419022:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015365632 00000100:00100000:1.0:1788305950.419027:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015365632 00000100:00100000:1.0:1788305950.419091:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788305950.419099:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+18:24226:x1875174015365632:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788305950.419108:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305950.419119:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88919d7df400/0x4a426866e605514b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6055144 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305950.419143:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88919d7df400/0x4a426866e605514b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6055144 expref: 19 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305950.419162:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88919d7df400/0x4a426866e605514b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6055144 expref: 19 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305950.419170:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88919d7df400, rc 0) 00000100:00100000:1.0:1788305950.419206:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+19:24226:x1875174015365632:12345-0@lo:101:mount.lustre.0 Request processed in 108us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305950.419212:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788305950.419266:0:24226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015365632:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788305950.419290:0:24226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6055144 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605514b expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305950.419305:0:24226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6055144 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e605514b expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788305950.420772:0:24226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1788305950.421599:0:24226:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305950.424911:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788305950.424977:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788305950.425005:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788305950.425023:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00010000:00010000:2.0:1788305950.425423:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788305950.425502:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788305950.425523:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788305950.425538:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788305950.425554:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788305950.425570:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1788305950.425583:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1788305950.425595:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1788305950.425607:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1788305950.425634:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1788305950.425640:0:24226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1788305950.425918:0:24226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188562300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015365760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305950.425985:0:24226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305950.426130:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015365760 00000100:00100000:0.0:1788305950.426137:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015365760 00000100:00100000:3.0:1788305950.426228:0:24226:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a31f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305950.426447:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788305950.426458:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+19:24226:x1875174015365760:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305950.426619:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+19:24226:x1875174015365760:12345-0@lo:501:mount.lustre.0 Request processed in 162us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305950.426628:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788305950.426903:0:24226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188562300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015365760:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305950.426943:0:24226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015365888:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788305950.427011:0:24226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305950.427405:0:24226:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cad50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305950.427467:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015365888 00000100:00100000:2.0:1788305950.427473:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015365888 00000100:00100000:2.0:1788305950.427513:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788305950.427522:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+19:24226:x1875174015365888:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788305950.428490:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+19:24226:x1875174015365888:12345-0@lo:503:mount.lustre.0 Request processed in 965us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305950.428500:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788305950.428605:0:24226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015365888:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788305950.429572:0:24226:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788305950.429928:0:24226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015366016:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305950.429990:0:24226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305950.430085:0:24226:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cad50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305950.430124:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015366016 00000100:00100000:3.0:1788305950.430131:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015366016 00000100:00100000:3.0:1788305950.430313:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788305950.430324:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+19:24226:x1875174015366016:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788305950.430832:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+19:24226:x1875174015366016:12345-0@lo:502:mount.lustre.0 Request processed in 509us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305950.430841:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788305950.430918:0:24226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015366016:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788305950.431129:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788305950.431167:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788305950.431181:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788305950.431193:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788305950.431206:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788305950.431218:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788305950.431231:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788305950.431243:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788305950.431256:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1788305950.431268:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1788305950.431309:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1788305950.431325:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1788305950.431351:0:24226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015366144:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305950.431392:0:24226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305950.431835:0:24226:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cad50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305950.431914:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015366144 00000100:00100000:0.0:1788305950.431920:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015366144 00000100:00100000:0.0:1788305950.431954:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788305950.431963:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+19:24226:x1875174015366144:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305950.432096:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+19:24226:x1875174015366144:12345-0@lo:502:mount.lustre.0 Request processed in 133us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305950.432104:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788305950.432262:0:24226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015366144:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788305950.432345:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1788305950.432356:0:24226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788305950.433544:0:24243:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788305950.433560:0:24243:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788305950.433567:0:24243:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305950.433569:0:24243:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788305950.433576:0:24243:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788305950.433591:0:24243:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff88918678cd28) 00000020:00000080:1.0:1788305950.433615:0:24243:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788305950.433620:0:24243:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788305950.433854:0:24243:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889182aee000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788305950.433862:0:24243:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788305950.433869:0:24243:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4a426866e6055159 00010000:00010000:1.0:1788305950.438859:0:24243:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788305950.439433:0:24243:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:1.0:1788305950.442894:0:24243:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1788305950.450100:0:24243:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788305950.450114:0:24243:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305950.450120:0:24243:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305950.450123:0:24243:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788305950.450126:0:24243:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788305950.450129:0:24243:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1788305950.450131:0:24243:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788305950.450132:0:24243:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788305950.450134:0:24243:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788305950.450136:0:24243:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305950.450137:0:24243:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788305950.450140:0:24243:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305950.450154:0:24243:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305950.450156:0:24243:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788305950.450160:0:24243:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788305950.450162:0:24243:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788305950.450165:0:24243:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305950.450167:0:24243:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305950.450168:0:24243:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788305950.450171:0:24243:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305950.450173:0:24243:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305950.450189:0:24243:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788305950.450193:0:24243:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788305950.450227:0:24243:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305950.450231:0:24243:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305950.450232:0:24243:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788305950.450235:0:24243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1788305950.450537:0:24226:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788305950.450568:0:24226:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788305950.450594:0:24226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6055144 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605514b expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305950.450605:0:24226:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6055144 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605514b expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305950.450613:0:24226:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889182aee000 from 1 10000000:01000000:3.0:1788305950.450617:0:24226:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788305950.450653:0:24226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181683400/0x4a426866e6055160 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305950.450662:0:24226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889181683400/0x4a426866e6055160 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305950.450744:0:24226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889181683400/0x4a426866e6055160 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305950.450790:0:24226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015366272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788305950.450859:0:24226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305950.450904:0:24226:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a31f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788305950.450958:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015366272 00000100:00100000:2.0:1788305950.450965:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015366272 00000100:00100000:2.0:1788305950.451015:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788305950.451025:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+19:24226:x1875174015366272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788305950.451038:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305950.451050:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891bb3eb200/0x4a426866e6055167 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6055160 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305950.451071:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3eb200/0x4a426866e6055167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6055160 expref: 20 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305950.451081:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891bb3eb200/0x4a426866e6055167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6055160 expref: 20 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305950.451089:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb200, rc 0) 00000100:00100000:2.0:1788305950.451133:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+20:24226:x1875174015366272:12345-0@lo:101:mount.lustre.0 Request processed in 109us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305950.451139:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788305950.455736:0:24226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015366272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305950.455777:0:24226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889181683400/0x4a426866e6055160 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055167 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305950.455791:0:24226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889181683400/0x4a426866e6055160 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6055167 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788305950.459557:0:24226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1788305950.459887:0:24226:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305950.460115:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788305950.460141:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788305950.460981:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788305950.461010:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788305950.461027:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788305950.461247:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788305950.461261:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788305950.461297:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788305950.461315:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788305950.461329:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1788305950.461341:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1788305950.462409:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1788305950.462424:0:24226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1788305950.462541:0:24226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015366400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305950.462612:0:24226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305950.462658:0:24226:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a31fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305950.463509:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015366400 00000100:00100000:0.0:1788305950.463519:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015366400 00000100:00100000:0.0:1788305950.463569:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788305950.463579:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+20:24226:x1875174015366400:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305950.464161:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+20:24226:x1875174015366400:12345-0@lo:501:mount.lustre.0 Request processed in 582us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305950.464169:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788305950.464402:0:24226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015366400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305950.464452:0:24226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015366528:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788305950.464498:0:24226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305950.464529:0:24226:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a31fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305950.465789:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015366528 00000100:00100000:2.0:1788305950.465800:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015366528 00000100:00100000:2.0:1788305950.465852:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788305950.465862:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+20:24226:x1875174015366528:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788305950.466005:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+20:24226:x1875174015366528:12345-0@lo:503:mount.lustre.0 Request processed in 145us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305950.466012:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788305950.467680:0:24226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015366528:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788305950.468158:0:24226:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788305950.468240:0:24226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015366656:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788305950.468608:0:24226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305950.468642:0:24226:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a31f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788305950.468788:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015366656 00000100:00100000:2.0:1788305950.468795:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015366656 00000100:00100000:2.0:1788305950.468840:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788305950.468849:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+20:24226:x1875174015366656:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305950.468960:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+20:24226:x1875174015366656:12345-0@lo:502:mount.lustre.0 Request processed in 111us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305950.468968:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788305950.469246:0:24226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015366656:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788305950.469577:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788305950.469607:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788305950.469622:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788305950.469636:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788305950.469649:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788305950.469662:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788305950.469688:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788305950.469703:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1788305950.469716:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788305950.469730:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1788305950.469742:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1788305950.469944:0:24226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015366784:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788305950.469992:0:24226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305950.470032:0:24226:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a31f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788305950.470331:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015366784 00000100:00100000:1.0:1788305950.470337:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015366784 00000100:00100000:1.0:1788305950.470383:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788305950.470391:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+20:24226:x1875174015366784:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305950.470494:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+20:24226:x1875174015366784:12345-0@lo:502:mount.lustre.0 Request processed in 103us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305950.470502:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788305950.470864:0:24226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015366784:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788305950.470918:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1788305950.470935:0:24226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788305950.472519:0:24247:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305950.472530:0:24247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305950.472533:0:24247:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788305950.472540:0:24247:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889182aee000 00000020:00000080:1.0:1788305950.472543:0:24247:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788305950.472551:0:24247:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305950.472554:0:24247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305950.472555:0:24247:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788305950.472558:0:24247:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305950.472560:0:24247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305950.472561:0:24247:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788305950.472565:0:24247:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889182aee000 00000020:00000080:1.0:1788305950.472567:0:24247:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788305950.472653:0:24247:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305950.472657:0:24247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305950.472659:0:24247:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788305950.472661:0:24247:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305950.472664:0:24247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305950.472665:0:24247:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788305950.472685:0:24247:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889182aee000 00000020:00000080:1.0:1788305950.472687:0:24247:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788305950.473091:0:24247:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305950.473096:0:24247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305950.473098:0:24247:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788305950.473100:0:24247:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305950.473103:0:24247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305950.473104:0:24247:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788305950.473107:0:24247:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889182aee000 00000020:00000080:1.0:1788305950.473109:0:24247:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788305950.473136:0:24247:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305950.473139:0:24247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305950.473141:0:24247:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788305950.473144:0:24247:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1788305950.477783:0:24226:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788305950.477839:0:24226:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788305950.477864:0:24226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181683400/0x4a426866e6055160 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055167 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305950.477877:0:24226:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889181683400/0x4a426866e6055160 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055167 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305950.477938:0:24226:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788305950.477941:0:24226:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff889182aee000 10000000:01000000:3.0:1788305950.477944:0:24226:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff889182aee000 10000000:01000000:3.0:1788305950.477948:0:24226:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788305950.477953:0:24226:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff889182aee000 from 1 10000000:01000000:3.0:1788305950.477955:0:24226:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788305950.477990:0:24226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181682200/0x4a426866e605516e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305950.478008:0:24226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889181682200/0x4a426866e605516e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305950.478019:0:24226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889181682200/0x4a426866e605516e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305950.478042:0:24226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015366912:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788305950.478105:0:24226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305950.478147:0:24226:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a31fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305950.478268:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015366912 00000100:00100000:0.0:1788305950.478299:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015366912 00000100:00100000:0.0:1788305950.478345:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788305950.478355:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+20:24226:x1875174015366912:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305950.478367:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305950.478380:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891a523b000/0x4a426866e6055175 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605516e expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305950.478400:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891a523b000/0x4a426866e6055175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605516e expref: 21 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305950.478409:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891a523b000/0x4a426866e6055175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605516e expref: 21 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305950.478418:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523b000, rc 0) 00000100:00100000:0.0:1788305950.478459:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:24226:x1875174015366912:12345-0@lo:101:mount.lustre.0 Request processed in 106us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305950.478466:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788305950.478909:0:24226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015366912:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305950.478926:0:24226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889181682200/0x4a426866e605516e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055175 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305950.478948:0:24226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889181682200/0x4a426866e605516e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6055175 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788305950.482978:0:24226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788305950.483271:0:24226:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305950.483593:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788305950.483617:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788305950.483631:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788305950.483644:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788305950.483657:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788305950.483749:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788305950.483891:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788305950.483908:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788305950.483921:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788305950.483933:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788305950.483945:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788305950.483958:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788305950.483971:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788305950.484009:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788305950.484026:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788305950.484040:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788305950.484055:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788305950.484068:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788305950.484082:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788305950.484097:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788305950.484112:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788305950.484127:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788305950.484141:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788305950.484157:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788305950.484172:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1788305950.484185:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1788305950.484211:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1788305950.484227:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1788305950.484241:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1788305950.484268:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1788305950.486215:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1788305950.486243:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1788305950.486256:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1788305950.486268:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1788305950.486303:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1788305950.486317:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1788305950.486329:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1788305950.486341:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1788305950.486354:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1788305950.486366:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1788305950.486381:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1788305950.486394:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1788305950.486407:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1788305950.486420:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1788305950.486432:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1788305950.486465:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1788305950.486481:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1788305950.486493:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1788305950.486657:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1788305950.486677:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1788305950.486694:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1788305950.486699:0:24226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1788305950.486824:0:24226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015367040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305950.486894:0:24226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305950.486941:0:24226:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a31fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788305950.487506:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015367040 00000100:00100000:0.0:1788305950.487515:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015367040 00000100:00100000:0.0:1788305950.487565:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788305950.487575:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:24226:x1875174015367040:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305950.488552:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:24226:x1875174015367040:12345-0@lo:501:mount.lustre.0 Request processed in 973us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305950.488563:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788305950.489895:0:24226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015367040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305950.489954:0:24226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015367168:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788305950.490036:0:24226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305950.490068:0:24226:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a31fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788305950.490213:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015367168 00000100:00100000:0.0:1788305950.490219:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015367168 00000100:00100000:0.0:1788305950.490261:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788305950.490270:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:24226:x1875174015367168:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788305950.490884:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:24226:x1875174015367168:12345-0@lo:503:mount.lustre.0 Request processed in 615us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305950.490893:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788305950.491017:0:24226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015367168:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788305950.492661:0:24226:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788305950.493523:0:24226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015367296:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788305950.493600:0:24226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305950.493646:0:24226:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a31fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305950.498124:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015367296 00000100:00100000:0.0:1788305950.498141:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015367296 00000100:00100000:0.0:1788305950.498195:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788305950.498206:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:24226:x1875174015367296:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305950.500243:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:24226:x1875174015367296:12345-0@lo:502:mount.lustre.0 Request processed in 2033us (6637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305950.500257:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788305950.500480:0:24226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015367296:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788305950.500864:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788305950.500894:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788305950.500906:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788305950.500917:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788305950.500927:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788305950.500938:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788305950.500949:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788305950.500960:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788305950.500971:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788305950.500981:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788305950.501013:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788305950.501026:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788305950.501037:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788305950.501061:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788305950.501073:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788305950.501084:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788305950.501095:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788305950.501105:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788305950.501116:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788305950.501127:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788305950.501138:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788305950.501148:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788305950.501159:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788305950.501170:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788305950.501181:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1788305950.501192:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1788305950.501203:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1788305950.501213:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1788305950.501224:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1788305950.501243:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1788305950.501255:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1788305950.501265:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1788305950.505240:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1788305950.505349:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1788305950.505366:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1788305950.505378:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1788305950.505390:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1788305950.505402:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1788305950.505415:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1788305950.505427:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1788305950.505440:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1788305950.505453:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1788305950.505466:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1788305950.505494:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1788305950.505509:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1788305950.505542:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1788305950.505558:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1788305950.505573:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1788305950.505632:0:24226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015367424:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305950.505710:0:24226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305950.505803:0:24226:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305950.511632:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015367424 00000100:00100000:1.0:1788305950.511645:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015367424 00000100:00100000:1.0:1788305950.511709:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788305950.511719:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:24226:x1875174015367424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305950.511884:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:24226:x1875174015367424:12345-0@lo:502:mount.lustre.0 Request processed in 166us (6173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305950.511892:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788305950.515937:0:24226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015367424:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788305950.516184:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1788305950.516214:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1788305950.516253:0:24226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015367552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305950.516344:0:24226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305950.516391:0:24226:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305950.516477:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015367552 00000100:00100000:1.0:1788305950.516485:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015367552 00000100:00100000:1.0:1788305950.516572:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788305950.516582:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:24226:x1875174015367552:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305950.516691:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:24226:x1875174015367552:12345-0@lo:502:mount.lustre.0 Request processed in 110us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305950.516700:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788305950.518936:0:24226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015367552:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788305950.519039:0:24226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1788305950.519053:0:24226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788305950.522547:0:24253:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788305950.522565:0:24253:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff889186220000) 00000020:00000080:2.0:1788305950.522592:0:24253:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1788305950.522695:0:24253:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889182aee000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788305950.522700:0:24253:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889182aee000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788305950.522702:0:24253:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889182aee000 3 00010000:00080000:2.0:1788305950.522732:0:24253:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88908259a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.155@tcp at head 00010000:00010000:3.0:1788305950.529588:0:24253:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788305950.529920:0:24253:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788305950.529982:0:24253:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788305950.530007:0:24253:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4a426866e6055183 00000100:00080000:3.0:1788305950.530019:0:24253:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788305950.530025:0:24253:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff88908259a800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305950.530058:0:24253:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889188560e00 x1875174015367680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788305950.530120:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875174015367680:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788305950.530191:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788305950.532055:0:24253:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788305950.533934:0:21146:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305950.533946:0:21146:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788305950.533949:0:21146:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305950.533952:0:21146:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788305950.533984:0:21146:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305950.533987:0:21146:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788305950.533989:0:21146:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305950.534002:0:21146:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788305950.534046:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015367808:0@lo:400:kworker.0 00000100:00100000:1.0:1788305950.534121:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305950.534155:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305950.534161:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015368192:0@lo:400:kworker.0 00000100:00100000:1.0:1788305950.534184:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305950.534215:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015367936:0@lo:400:kworker.0 00000100:00100000:1.0:1788305950.534234:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305950.534248:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788305950.534253:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015368064:0@lo:400:kworker.0 00000100:00100000:1.0:1788305950.534269:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305950.534331:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015367808 00000100:00100000:1.0:1788305950.534339:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015367808 00000100:00100000:1.0:1788305950.534375:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015368064 00000100:00100000:1.0:1788305950.534378:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015368064 00000100:00100000:1.0:1788305950.534392:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788305950.534400:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015367808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305950.534446:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015367808:12345-0@lo:400:kworker.0 Request processed in 46us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305950.534470:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788305950.534486:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788305950.534492:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015368064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305950.534521:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015368064:12345-0@lo:400:kworker.0 Request processed in 29us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305950.534527:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788305950.534545:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015367680 00000100:00100000:1.0:1788305950.534548:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015367680 00000100:00100000:1.0:1788305950.534563:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015368192 00000100:00100000:1.0:1788305950.534565:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015368192 00000100:00100000:1.0:1788305950.534576:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015367936 00000100:00100000:1.0:1788305950.534578:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015367936 00000100:00100000:1.0:1788305950.534588:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788305950.534593:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015368192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305950.534616:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015368192:12345-0@lo:400:kworker.0 Request processed in 24us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305950.534621:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788305950.534631:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305950.534635:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015367936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305950.534654:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015367936:12345-0@lo:400:kworker.0 Request processed in 19us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305950.534659:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305950.534668:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788305950.534672:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875174015367680:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788305950.534692:0:22723:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 780 last 0 00000020:00000080:1.0:1788305950.534724:0:22723:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4a426866e605518a 00000004:00100000:1.0:1788305950.534743:0:22723:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788305950.537315:0:22723:0:(import.c:65:import_set_state_nolock()) ffff8890836ce800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305950.537410:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875174015367680:12345-0@lo:38:llog_process_th.0 Request processed in 2732us (7216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305950.537421:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788305950.537488:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015368064:0@lo:400:kworker.0 00010000:00080000:1.0:1788305950.537505:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891bb23c700 x1875174015367936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305950.537515:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015367936:0@lo:400:kworker.0 00010000:00080000:1.0:1788305950.537550:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891bfaa7100 x1875174015368192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305950.537560:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015368192:0@lo:400:kworker.0 00000100:00100000:1.0:1788305950.537573:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015367808:0@lo:400:kworker.0 00000020:01000004:3.0:1788305950.537928:0:24253:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788305950.537944:0:24253:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8891b917b370) 00000020:00000080:3.0:1788305950.537963:0:24253:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788305950.538073:0:24253:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889182aee000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788305950.538077:0:24253:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889182aee000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788305950.538080:0:24253:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889182aee000 3 00010000:00080000:3.0:1788305950.538108:0:24253:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88918c9a5000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.155@tcp at head 00010000:00080000:2.0:1788305950.540384:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889188560e00 x1875174015367680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305950.540399:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788305950.540418:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788305950.540427:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788305950.540434:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788305950.540438:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908259a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788305950.540446:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875174015367680:0@lo:38:llog_process_th.0 00010000:00010000:3.0:1788305950.540852:0:24253:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788305950.541099:0:24253:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788305950.541143:0:24253:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788305950.541155:0:24253:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x4a426866e6055198 00000100:00080000:3.0:1788305950.541169:0:24253:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788305950.541174:0:24253:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff88918c9a5000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305950.541202:0:24253:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889188561f80 x1875174015368320/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788305950.541227:0:24253:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788305950.541949:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875174015368320:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788305950.542032:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305950.542330:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015368320 00000100:00100000:0.0:1788305950.542337:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015368320 00000100:00100000:0.0:1788305950.542373:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788305950.542382:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875174015368320:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788305950.542424:0:22721:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 780 last 0 00000020:00000080:0.0:1788305950.542497:0:22721:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x4a426866e605519f 00000004:00100000:0.0:1788305950.542512:0:22721:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788305950.542544:0:22721:0:(import.c:65:import_set_state_nolock()) ffff8891c123b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305950.542599:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875174015368320:12345-0@lo:38:llog_process_th.0 Request processed in 217us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305950.542607:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788305950.542647:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889188561f80 x1875174015368320/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305950.542668:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788305950.542675:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1788305950.542681:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788305950.542685:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788305950.542688:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88918c9a5000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788305950.542694:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875174015368320:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788305950.543155:0:24253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1788305950.543770:0:24226:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788305950.543803:0:24226:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788305950.543821:0:24226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181682200/0x4a426866e605516e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055175 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305950.543832:0:24226:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889181682200/0x4a426866e605516e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055175 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788305950.543875:0:24226:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788305950.543877:0:24226:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788305950.543878:0:24226:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305950.543879:0:24226:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305950.543881:0:24226:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305950.543882:0:24226:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305950.543883:0:24226:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788305950.543885:0:24226:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305950.543887:0:24226:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788305950.543890:0:24226:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788305950.543893:0:24226:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788305950.543894:0:24226:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788305950.543895:0:24226:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305950.543896:0:24226:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305950.543897:0:24226:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305950.543898:0:24226:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305950.543899:0:24226:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788305950.543904:0:24226:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305950.543905:0:24226:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788305950.543923:0:24226:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788305950.543936:0:24226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015368448:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788305950.543979:0:24226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305950.544011:0:24226:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2780 going to sleep for 11 seconds 00000100:00100000:2.0:1788305950.544029:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015368448 00000100:00100000:2.0:1788305950.544033:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015368448 00000100:00100000:2.0:1788305950.544063:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788305950.544070:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:24226:x1875174015368448:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788305950.544089:0:22715:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788305950.544102:0:22715:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:0.0:1788305950.546551:0:21146:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305950.546560:0:21146:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788305950.546563:0:21146:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305950.546566:0:21146:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788305950.546570:0:21146:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305950.546572:0:21146:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788305950.546575:0:21146:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305950.546578:0:21146:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 20000000:01000000:3.0:1788305950.553957:0:22715:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788305950.553975:0:22715:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788305950.554214:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:24226:x1875174015368448:12345-0@lo:253:mount.lustre.0 Request processed in 10139us (10229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305950.554227:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 20000000:01000000:2.0:1788305950.554527:0:22737:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788305950.554532:0:22737:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788305950.554551:0:22737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8891bb3eae00/0x4a426866e60551a6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305950.554566:0:22737:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891a523be00/0x4a426866e60550f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60550e9 expref: 20 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305950.554574:0:22737:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181682e00/0x4a426866e60550fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60550f7 expref: 20 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305950.554582:0:22737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8891bb3eae00/0x4a426866e60551a6 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305950.554618:0:22737:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181682e00/0x4a426866e60550fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60550f7 expref: 20 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305950.554631:0:22737:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889181682e00/0x4a426866e60550fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60550f7 expref: 20 pid: 22716 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305950.554658:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22737:1875174015368576:0@lo:104: 00000100:00100000:2.0:1788305950.554843:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788305950.554891:0:22737:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891a523be00/0x4a426866e60550f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60550e9 expref: 20 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305950.554901:0:22737:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8891a523be00/0x4a426866e60550f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60550e9 expref: 20 pid: 22715 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305950.554909:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3aa300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22737:1875174015368704:0@lo:104: 00000100:00100000:2.0:1788305950.554934:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305950.554950:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305950.554986:0:24226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:24226:1875174015368448:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788305950.555008:0:24226:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788305950.555011:0:24226:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788305950.555013:0:24226:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788305950.555014:0:24226:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305950.555015:0:24226:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305950.555016:0:24226:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305950.555017:0:24226:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305950.555019:0:24226:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788305950.555021:0:24226:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305950.555023:0:24226:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788305950.555039:0:24226:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788305950.555516:0:22706:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788305950.555530:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015368576 00000100:00100000:2.0:1788305950.555536:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015368576 00000100:00100000:2.0:1788305950.555562:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015368704 00000100:00100000:2.0:1788305950.555565:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015368704 00000100:00100000:2.0:1788305950.555578:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788305950.555586:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+4:22737:x1875174015368576:12345-0@lo:104: 00010000:00010000:2.0:1788305950.555606:0:22706:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889180031a00/0x4a426866e60550f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60550fe expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305950.555664:0:22706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1788305950.555846:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305950.555853:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889180031a00/0x4a426866e60550f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60550fe expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305950.555860:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889180031a00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:0.0:1788305950.555863:0:22711:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889180031a00/0x4a426866e60550f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60550fe expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305950.555871:0:22711:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889180031a00/0x4a426866e60550f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60550fe expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305950.555885:0:22711:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889180031a00/0x4a426866e60550f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60550fe expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305950.555891:0:22711:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788305950.555920:0:22711:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889180031a00/0x4a426866e60550f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60550fe expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305950.555927:0:22711:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305950.555949:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889180031a00/0x4a426866e60550f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60550fe expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305950.555955:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889180031a00/0x4a426866e60550f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60550fe expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305950.555968:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305950.555970:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305950.555972:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305950.555986:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305950.556007:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4402ecd-e8a2-4271-82d7-771a7bb97982:3649:1875174015368832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305950.556040:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305950.556077:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015368832 00000100:00100000:0.0:1788305950.556081:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015368832 00010000:00010000:0.0:1788305950.556098:0:22708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181682e00/0x4a426866e60550fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60550f7 expref: 21 pid: 22716 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305950.556120:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788305950.556126:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:3649:x1875174015368832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305950.556135:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305950.556148:0:22708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181682e00/0x4a426866e60550fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60550f7 expref: 21 pid: 22716 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305950.556158:0:22708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181682e00/0x4a426866e60550fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60550f7 expref: 21 pid: 22716 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305950.556173:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305950.556202:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:3649:x1875174015368832:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305950.556210:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788305950.556241:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4402ecd-e8a2-4271-82d7-771a7bb97982:3649:1875174015368832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305950.557269:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+4:22737:x1875174015368576:12345-0@lo:104: Request processed in 1680us (2423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305950.557296:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788305950.557316:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788305950.557325:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+3:22737:x1875174015368704:12345-0@lo:104: 00010000:00010000:2.0:1788305950.557336:0:22706:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889181683200/0x4a426866e60550e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60550f0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305950.557395:0:22706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788305950.557401:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+3:22737:x1875174015368704:12345-0@lo:104: Request processed in 79us (2467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305950.557407:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788305950.557492:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181682e00/0x4a426866e60550fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60550f7 expref: 20 pid: 22716 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305950.557503:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22737:1875174015368576:0@lo:104: 00000100:00100000:2.0:1788305950.557513:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3aa300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22737:1875174015368704:0@lo:104: 00010000:00010000:2.0:1788305950.557532:0:22737:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8891bb3eae00/0x4a426866e60551a6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305950.557638:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305950.557645:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181683200/0x4a426866e60550e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60550f0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305950.557651:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181683200 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:1.0:1788305950.557655:0:22710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181683200/0x4a426866e60550e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60550f0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305950.557663:0:22710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181683200/0x4a426866e60550e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60550f0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305950.557847:0:22710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181683200/0x4a426866e60550e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60550f0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305950.557866:0:22710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788305950.557903:0:22710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181683200/0x4a426866e60550e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60550f0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305950.557909:0:22710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305950.557934:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181683200/0x4a426866e60550e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60550f0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305950.557940:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181683200/0x4a426866e60550e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60550f0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305950.557955:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305950.557957:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305950.557958:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305950.557966:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305950.557978:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4402ecd-e8a2-4271-82d7-771a7bb97982:3648:1875174015368960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305950.558029:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305950.558073:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015368960 00000100:00100000:1.0:1788305950.558078:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015368960 00010000:00010000:1.0:1788305950.558095:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891a523be00/0x4a426866e60550f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60550e9 expref: 20 pid: 22715 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305950.558118:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788305950.558124:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb360850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4402ecd-e8a2-4271-82d7-771a7bb97982+20:3648:x1875174015368960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305950.558133:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305950.558137:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891a523be00/0x4a426866e60550f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60550e9 expref: 20 pid: 22715 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305950.558148:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891a523be00/0x4a426866e60550f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60550e9 expref: 20 pid: 22715 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305950.558167:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891a523be00/0x4a426866e60550f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60550e9 expref: 20 pid: 22715 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305950.558178:0:22709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8891bb3eae00/0x4a426866e60551a6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305950.558186:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3eae00/0x4a426866e60551a6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788305950.558199:0:22709:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009268575s 00010000:00010000:1.0:1788305950.558204:0:22709:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8891bb3eae00/0x4a426866e60551a6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305950.558210:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8891bb3eae00/0x4a426866e60551a6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305950.558216:0:22709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8891bb3eae00/0x4a426866e60551a6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305950.558222:0:22709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8891bb3eae00/0x4a426866e60551a6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305950.558228:0:22709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eae00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305950.558232:0:22709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8891bb3eae00/0x4a426866e60551a6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305950.558239:0:22709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8891bb3eae00/0x4a426866e60551a6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305950.558251:0:22709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8891bb3eae00/0x4a426866e60551a6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305950.558266:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305950.558330:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb360850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4402ecd-e8a2-4271-82d7-771a7bb97982+19:3648:x1875174015368960:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305950.558336:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788305950.558400:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4402ecd-e8a2-4271-82d7-771a7bb97982:3648:1875174015368960:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788305950.558512:0:22737:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8891bb3eae00/0x4a426866e60551a6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305950.558520:0:22737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8891bb3eae00/0x4a426866e60551a6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305950.558534:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3eae00/0x4a426866e60551a6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1788305950.559915:0:24226:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788305950.562382:0:24226:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788305950.562390:0:24226:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788305950.562431:0:24226:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788305950.562473:0:24226:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.155@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788305950.562496:0:24226:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788305950.562518:0:24226:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788305950.563848:0:24226:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788305950.564088:0:24226:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1788305950.806937:0:22756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788305951.449916:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788305951.622437:0:24307:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788305951.622736:0:24307:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1788305952.277466:0:22720:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788305952.277473:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8891bfab2000 from 13 10000000:01000000:0.0:1788305952.277478:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788305952.277522:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e60551ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305952.277533:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e60551ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305952.277545:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e60551ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305952.277569:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb36d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015369088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788305952.277634:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305952.277682:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891baf65c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305952.277735:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015369088 00000100:00100000:1.0:1788305952.277744:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015369088 00000100:00100000:1.0:1788305952.277801:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788305952.277810:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+19:22720:x1875174015369088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305952.277822:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305952.277836:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88919d7df200/0x4a426866e60551b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60551ad expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305952.277860:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88919d7df200/0x4a426866e60551b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60551ad expref: 20 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305952.277871:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88919d7df200/0x4a426866e60551b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60551ad expref: 20 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305952.277880:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88919d7df200, rc 0) 00000100:00100000:1.0:1788305952.277928:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+20:22720:x1875174015369088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305952.277934:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788305952.278077:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb36d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015369088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305952.278091:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e60551ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60551b4 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305952.278114:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e60551ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60551b4 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305952.278161:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb36d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015369216:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788305952.278191:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305952.278217:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891baf65c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788305952.278303:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015369216 00000100:00100000:3.0:1788305952.278308:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015369216 00000100:00100000:3.0:1788305952.278340:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788305952.278346:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+20:22720:x1875174015369216:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788305952.278360:0:22715:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788305952.278378:0:22715:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788305952.278381:0:22715:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1788305952.278452:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+20:22720:x1875174015369216:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305952.278464:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788305952.278571:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb36d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015369216:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788305952.278629:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788305952.278637:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e60551ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60551b4 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305952.278644:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e60551ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60551b4 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305952.278653:0:22720:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788305952.278655:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8891bbb3a800 from 13 10000000:01000000:0.0:1788305952.278658:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788305952.278673:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60551bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305952.278681:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60551bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305952.278688:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60551bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305952.278701:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb36d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015369344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788305952.278733:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305952.278759:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891baf65c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305952.278815:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015369344 00000100:00100000:2.0:1788305952.278820:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015369344 00000100:00100000:2.0:1788305952.278854:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788305952.278861:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+20:22720:x1875174015369344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305952.278869:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305952.278878:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891bb3eba00/0x4a426866e60551c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60551bb expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305952.278894:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3eba00/0x4a426866e60551c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60551bb expref: 21 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305952.278902:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891bb3eba00/0x4a426866e60551c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60551bb expref: 21 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305952.278909:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eba00, rc 0) 00000100:00100000:2.0:1788305952.278949:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:22720:x1875174015369344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305952.278955:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788305952.279108:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb36d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015369344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305952.279119:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60551bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60551c2 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305952.279127:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60551bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60551c2 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305952.279168:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb36d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015369472:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788305952.279197:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305952.279219:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891baf65c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305952.279302:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015369472 00000100:00100000:1.0:1788305952.279306:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015369472 00000100:00100000:1.0:1788305952.279332:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788305952.279345:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:22720:x1875174015369472:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788305952.279357:0:22716:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788305952.279368:0:22716:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788305952.279370:0:22716:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1788305952.279434:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:22720:x1875174015369472:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 89us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305952.279440:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788305952.279797:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb36d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015369472:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788305952.279842:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788305952.279849:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60551bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60551c2 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305952.279857:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60551bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60551c2 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305952.469715:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305953.495641:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305953.750565:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788305953.750589:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015369600:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305953.750658:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305953.750708:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015369600 00000100:00100000:3.0:1788305953.750716:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015369600 00000100:00100000:3.0:1788305953.750766:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788305953.750775:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015369600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788305953.750809:0:22726:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788305953.750859:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015369600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305953.750865:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788305953.750912:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015369600:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305954.263111:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015369728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305954.263186:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305954.263404:0:23464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015369728 00000100:00100000:1.0:1788305954.263413:0:23464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015369728 00000100:00100000:1.0:1788305954.263460:0:23464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788305954.263470:0:23464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015369728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788305954.263504:0:23464:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788305954.263551:0:23464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015369728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305954.263557:0:23464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788305954.263604:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015369728:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788305954.518451:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788305955.034079:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788305955.542465:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788305955.804319:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305955.804326:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788305955.804329:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305955.804339:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788305955.804357:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305955.804360:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788305955.804363:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305955.804366:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788305955.804409:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015370240:0@lo:400:kworker.0 00000100:00100000:2.0:1788305955.804483:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305955.804524:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788305955.804529:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4402ecd-e8a2-4271-82d7-771a7bb97982:3649:1875174015369856:0@lo:400:kworker.0 00000100:00100000:2.0:1788305955.804557:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305955.804584:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015370368:0@lo:400:kworker.0 00000100:00100000:2.0:1788305955.804612:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305955.804639:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015369984:0@lo:400:kworker.0 00000100:00100000:2.0:1788305955.804661:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305955.804676:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015370496:0@lo:400:kworker.0 00000100:00100000:2.0:1788305955.804692:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305955.804705:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788305955.804709:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015370112:0@lo:400:kworker.0 00000100:00100000:2.0:1788305955.804728:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305955.804745:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015370624:0@lo:400:kworker.0 00000100:00100000:2.0:1788305955.804764:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305955.804800:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015370240 00000100:00100000:2.0:1788305955.804808:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015370240 00000100:00100000:2.0:1788305955.804855:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015369984 00000100:00100000:2.0:1788305955.804859:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015369984 00000100:00100000:2.0:1788305955.804874:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788305955.804881:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015370240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305955.804934:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015370240:12345-0@lo:400:kworker.0 Request processed in 53us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305955.804942:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788305955.804971:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788305955.804977:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015369984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305955.805008:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015369984:12345-0@lo:400:kworker.0 Request processed in 32us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305955.805014:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788305955.805041:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015369856 00000100:00100000:2.0:1788305955.805045:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015369856 00000100:00100000:2.0:1788305955.805067:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788305955.805072:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:3649:x1875174015369856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305955.805461:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:3649:x1875174015369856:12345-0@lo:400:kworker.0 Request processed in 24us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305955.805469:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788305955.805502:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015370368 00000100:00100000:2.0:1788305955.805506:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015370368 00000100:00100000:2.0:1788305955.805522:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015370496 00000100:00100000:2.0:1788305955.805524:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015370496 00000100:00100000:2.0:1788305955.805542:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015370112 00000100:00100000:2.0:1788305955.805544:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015370112 00000100:00100000:2.0:1788305955.805552:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015370624 00000100:00100000:2.0:1788305955.805554:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015370624 00000100:00100000:2.0:1788305955.805566:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788305955.805572:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015370368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305955.805622:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015370368:12345-0@lo:400:kworker.0 Request processed in 50us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305955.805628:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788305955.805639:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788305955.805646:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015370496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305955.805672:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015370496:12345-0@lo:400:kworker.0 Request processed in 28us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305955.805678:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788305955.805688:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788305955.805693:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015370112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305955.805716:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015370112:12345-0@lo:400:kworker.0 Request processed in 23us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305955.805722:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788305955.805732:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788305955.805737:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015370624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305955.805761:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015370624:12345-0@lo:400:kworker.0 Request processed in 25us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305955.805767:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788305955.805819:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb3abb80 x1875174015370112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305955.805834:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015370112:0@lo:400:kworker.0 00010000:00080000:2.0:1788305955.805845:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb3ab800 x1875174015370624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305955.805852:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015370624:0@lo:400:kworker.0 00000100:00100000:2.0:1788305955.805870:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015369984:0@lo:400:kworker.0 00010000:00080000:2.0:1788305955.805880:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb3a9c00 x1875174015370496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305955.805887:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015370496:0@lo:400:kworker.0 00000100:00100000:2.0:1788305955.805919:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4402ecd-e8a2-4271-82d7-771a7bb97982:3649:1875174015369856:0@lo:400:kworker.0 00010000:00080000:2.0:1788305955.805929:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb3a9180 x1875174015370368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305955.805937:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015370368:0@lo:400:kworker.0 00000100:00100000:2.0:1788305955.805956:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015370240:0@lo:400:kworker.0 00000100:00080000:0.0:1788305955.806189:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305955.806194:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788305956.566211:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305957.590668:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788305957.900690:0:24598:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788305958.617422:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788305958.800617:0:24650:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788305958.800949:0:24650:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788305958.869572:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305958.869598:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015370752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305958.869690:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305958.870030:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015370752 00000100:00100000:2.0:1788305958.870039:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015370752 00000100:00100000:2.0:1788305958.870087:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788305958.870097:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015370752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788305958.870132:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788305958.870184:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015370752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305958.870191:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788305958.870239:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015370752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305959.381689:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015370880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305959.381925:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305959.382866:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015370880 00000100:00100000:1.0:1788305959.382881:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015370880 00000100:00100000:1.0:1788305959.382957:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788305959.382968:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015370880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788305959.383013:0:22726:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788305959.383082:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015370880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305959.383089:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788305959.383321:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015370880:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788305959.640687:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305959.765354:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305944/real 1788305944] req@ffff8891afb37b80 x1875174015363200/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305959 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305959.765386:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8891afb37b80 x1875174015363200/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305959 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305959.765409:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305944/real 1788305944] req@ffff8891afb34000 x1875174015363328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305959 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305959.765422:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8891afb34000 x1875174015363328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305959 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788305959.765442:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889183841800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788305959.765470:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788305959.765475:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015363200:0@lo:8:kworker.0 00000100:00080000:2.0:1788305959.765480:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908273d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788305959.765486:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788305959.765489:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015363328:0@lo:8:kworker.0 00000100:00080000:1.0:1788305959.765621:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305959.765626:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788305959.765629:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305959.765631:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788305959.765656:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305959.765659:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788305959.765662:0:36:0:(import.c:65:import_set_state_nolock()) ffff889183841800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305959.765667:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 774 00000100:00080000:1.0:1788305959.765672:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788305959.765677:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff889183841800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305959.765697:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bfaa6680 x1875174015371392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305959.765721:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305959.765724:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788305959.765726:0:36:0:(import.c:65:import_set_state_nolock()) ffff88908273d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305959.765728:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 774 00000100:00080000:1.0:1788305959.765731:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788305959.765734:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff88908273d800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305959.765745:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bfaa6d80 x1875174015371520/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788305959.765783:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015371136:0@lo:400:kworker.0 00000100:00100000:1.0:1788305959.765843:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305959.765872:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015371904:0@lo:400:kworker.0 00000100:00100000:1.0:1788305959.765922:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305959.765944:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788305959.765949:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4402ecd-e8a2-4271-82d7-771a7bb97982:3648:1875174015371008:0@lo:400:kworker.0 00000100:00100000:1.0:1788305959.765977:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305959.766001:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015371776:0@lo:400:kworker.0 00000100:00100000:1.0:1788305959.766024:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305959.766060:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015371648:0@lo:400:kworker.0 00000100:00100000:1.0:1788305959.766080:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305959.766096:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305959.766100:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015371264:0@lo:400:kworker.0 00000100:00100000:1.0:1788305959.766120:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305959.766146:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015371136 00000100:00100000:1.0:1788305959.766154:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015371136 00000100:00100000:1.0:1788305959.766194:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015371904 00000100:00100000:1.0:1788305959.766197:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015371904 00000100:00100000:1.0:1788305959.766223:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015371776 00000100:00100000:1.0:1788305959.766226:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015371776 00000100:00100000:1.0:1788305959.766237:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015371648 00000100:00100000:1.0:1788305959.766239:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015371648 00000100:00100000:1.0:1788305959.766253:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788305959.766261:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015371136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305959.766342:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015371136:12345-0@lo:400:kworker.0 Request processed in 82us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305959.766349:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788305959.766364:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788305959.766369:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015371904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305959.766390:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015371904:12345-0@lo:400:kworker.0 Request processed in 22us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305959.766402:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788305959.766413:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788305959.766418:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015371776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305959.766440:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015371776:12345-0@lo:400:kworker.0 Request processed in 23us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305959.766445:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788305959.766454:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788305959.766459:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015371648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305959.766481:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015371648:12345-0@lo:400:kworker.0 Request processed in 22us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305959.766485:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788305959.766505:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015371008 00000100:00100000:1.0:1788305959.766508:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015371008 00000100:00100000:1.0:1788305959.766529:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788305959.766534:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083098850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:3648:x1875174015371008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305959.766556:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083098850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:3648:x1875174015371008:12345-0@lo:400:kworker.0 Request processed in 22us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305959.766561:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788305959.766591:0:23464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015371264 00000100:00100000:1.0:1788305959.766594:0:23464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015371264 00000100:00100000:1.0:1788305959.766612:0:23464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788305959.766617:0:23464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015371264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305959.766640:0:23464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015371264:12345-0@lo:400:kworker.0 Request processed in 24us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305959.766645:0:23464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788305959.766666:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788305959.766670:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788305959.766701:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015371264:0@lo:400:kworker.0 00010000:00080000:1.0:1788305959.766710:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bfaa4a80 x1875174015371648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305959.766719:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015371648:0@lo:400:kworker.0 00000100:00100000:1.0:1788305959.766737:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015371392:0@lo:8:kworker.0 00000100:00100000:1.0:1788305959.766759:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305959.766776:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015371520:0@lo:8:kworker.0 00000100:00100000:1.0:1788305959.766790:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305959.766817:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015371392 00000100:00100000:1.0:1788305959.766821:0:24232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015371392 00000100:00100000:1.0:1788305959.766833:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015371520 00000100:00100000:1.0:1788305959.766835:0:24232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015371520 00000100:00100000:1.0:1788305959.766843:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305959.766848:0:24232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875174015371392:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788305959.766873:0:24232:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 789 last 0 00000020:00000080:1.0:1788305959.766901:0:24232:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4a426866e60551c9 00002000:00100000:1.0:1788305959.766932:0:24232:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8890836ca800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788305959.766936:0:24232:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1788305959.766939:0:24232:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788305959.767131:0:24232:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788305959.767155:0:24232:0:(import.c:65:import_set_state_nolock()) ffff8890836c8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305959.767213:0:24232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1875174015371392:12345-0@lo:8:kworker.0 Request processed in 362us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305959.767221:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305959.767240:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788305959.767244:0:24232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875174015371520:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788305959.767256:0:24232:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1788305959.768154:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bfaa6680 x1875174015371392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788305979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305959.768168:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788305959.768176:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788305959.768184:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788305959.768200:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788305959.768203:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889183841800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788305959.768228:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788305959.768233:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015371392:0@lo:8:kworker.0 00000004:00080000:3.0:1788305959.768314:0:23465:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788305959.768401:0:23465:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 789859125505ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788305959.768408:0:23465:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1788305959.768460:0:23466:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788305959.768478:0:23466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23466:1875174015372160:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788305959.768537:0:23466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305959.768552:0:23466:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af30c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305959.768573:0:24231:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788305959.768580:0:24231:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788305959.768594:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015372032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305959.768617:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305959.768647:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015372032 00000100:00100000:2.0:1788305959.768653:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015372032 00000100:00100000:2.0:1788305959.768694:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788305959.768818:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875174015372032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788305959.768844:0:24234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788305959.768887:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875174015372032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 186us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305959.768890:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015372160 00000100:00100000:3.0:1788305959.768894:0:24231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015372160 00000100:00100000:2.0:1788305959.768895:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788305959.768944:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889188560000 x1875174015372032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305959.768958:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015372032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305959.768982:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788305959.768989:0:24697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188561f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23466:x1875174015372160:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:3.0:1788305959.770920:0:24697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788305959.770929:0:24697:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788305959.771010:0:24697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188561f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23466:x1875174015372160:12345-0@lo:7:osp-pre-0-1.0 Request processed in 2018us (2469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305959.771020:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788305959.771078:0:23466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889188563800 x1875174015372160/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788305975 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305959.771092:0:23466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23466:1875174015372160:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788305959.771112:0:23466:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788305959.771145:0:23466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23466:1875174015372288:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788305959.771177:0:23466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305959.771196:0:23466:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af30c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305959.771215:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015372288 00000100:00100000:3.0:1788305959.771220:0:24231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015372288 00000100:00100000:3.0:1788305959.771374:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788305959.771384:0:24231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188563100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23466:x1875174015372288:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788305959.771477:0:24231:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1788305959.771577:0:24231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188563100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23466:x1875174015372288:12345-0@lo:5:osp-pre-0-1.0 Request processed in 196us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305959.771584:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788305959.771608:0:23466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889188563800 x1875174015372288/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788305975 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305959.771618:0:23466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23466:1875174015372288:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788305959.771627:0:23466:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788305959.771650:0:23466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23466:1875174015372416:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788305959.771672:0:23466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305959.771752:0:23466:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af30c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305959.771764:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015372416 00000100:00100000:3.0:1788305959.771767:0:24231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015372416 00000100:00100000:3.0:1788305959.771784:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788305959.771790:0:24231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188562300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23466:x1875174015372416:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788305959.771813:0:24231:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:0.0:1788305959.776366:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4402ecd-e8a2-4271-82d7-771a7bb97982:3648:1875174015371008:0@lo:400:kworker.0 00010000:00080000:0.0:1788305959.776391:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bfaa6300 x1875174015371776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305959.776406:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015371776:0@lo:400:kworker.0 00010000:00080000:0.0:1788305959.776419:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bfaa4e00 x1875174015371136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305959.776428:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015371136:0@lo:400:kworker.0 00010000:00080000:0.0:1788305959.776440:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bfaa5f80 x1875174015371904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305959.776448:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015371904:0@lo:400:kworker.0 00000100:00080000:0.0:1788305959.776658:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788305959.779827:0:23456:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788305959.812221:0:24232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875174015371520:12345-0@lo:8:kworker.0 Request processed in 44965us (45419us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788305959.812244:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788305959.812320:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908273d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305959.812325:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788305959.812329:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015371520:0@lo:8:kworker.0 00000001:00080000:0.0:1788305959.829707:0:24227:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:0.0:1788305959.829730:0:24227:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788305959.830677:0:24231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188562300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23466:x1875174015372416:12345-0@lo:5:osp-pre-0-1.0 Request processed in 58876us (58993us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788305959.830698:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788305959.831224:0:23466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889188563800 x1875174015372416/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788305975 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305959.831241:0:23466:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788305959.831262:0:23466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23466:1875174015372416:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788305959.831303:0:23466:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:0.0:1788305959.831393:0:23466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb36d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23466:1875174015372544:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788305959.831464:0:23466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305959.831624:0:23466:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b8f89000 going to sleep for 11 seconds 00000100:00100000:3.0:1788305959.833113:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015372544 00000100:00100000:3.0:1788305959.833126:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015372544 00000100:00100000:3.0:1788305959.833195:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305959.833204:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23466:x1875174015372544:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788305959.833326:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23466:x1875174015372544:12345-0@lo:900:osp-pre-0-1.0 Request processed in 122us (1860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305959.833333:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788305959.833433:0:23466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891afb36d80 x1875174015372544/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788305975 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305959.833448:0:23466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb36d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23466:1875174015372544:0@lo:900:osp-pre-0-1.0 00000020:00000004:2.0:1788305959.836874:0:24701:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788305959.837121:0:24701:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1788305960.031129:0:22756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788305960.662769:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305961.688044:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305962.710368:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305963.733456:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305963.861380:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305943/real 1788305943] req@ffff8891afb37100 x1875174015361920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305963 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305963.861419:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8891afb37100 x1875174015361920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305963 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305963.861431:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305943/real 1788305943] req@ffff8891afb37800 x1875174015362048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305963 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305963.861443:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8891afb37800 x1875174015362048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305963 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788305963.861466:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bb1ed800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305963.861492:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788305963.861497:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015361920:0@lo:8:kworker.0 00000100:00080000:0.0:1788305963.861504:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908353f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305963.861511:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788305963.861514:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015362048:0@lo:8:kworker.0 00000100:00080000:3.0:1788305963.862318:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788305963.862325:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788305963.862328:0:8:0:(import.c:65:import_set_state_nolock()) ffff8891bb1ed800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788305963.862336:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 773 00000100:00080000:3.0:1788305963.862343:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788305963.862360:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8891bb1ed800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305963.862384:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889188560000 x1875174015372928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788305963.862399:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788305963.862402:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788305963.862403:0:8:0:(import.c:65:import_set_state_nolock()) ffff88908353f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788305963.862406:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 773 00000100:00080000:3.0:1788305963.862409:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788305963.862412:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88908353f000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305963.862425:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb355880 x1875174015373056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788305963.862475:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788305963.862479:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788305963.862481:0:8:0:(import.c:65:import_set_state_nolock()) ffff88908273d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788305963.862485:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 789 00000100:00080000:3.0:1788305963.862488:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:0.0:1788305963.862489:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015373184:0@lo:400:kworker.0 00000100:00080000:3.0:1788305963.862492:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff88908273d800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305963.862503:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb355f80 x1875174015373568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788305963.862538:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015373312:0@lo:400:kworker.0 00000100:00100000:1.0:1788305963.862609:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4402ecd-e8a2-4271-82d7-771a7bb97982:3650:1875174015372672:0@lo:400:kworker.0 00000100:00100000:3.0:1788305963.869260:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305963.869260:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015372800:0@lo:400:kworker.0 00000100:00100000:2.0:1788305963.869323:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305963.869345:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015373952:0@lo:400:kworker.0 00000100:00100000:2.0:1788305963.869351:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015373696:0@lo:400:kworker.0 00000100:00100000:2.0:1788305963.869378:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305963.869408:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305963.869415:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015373824:0@lo:400:kworker.0 00000100:00100000:2.0:1788305963.869440:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305963.869477:0:23464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015373312 00000100:00100000:2.0:1788305963.869487:0:23464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015373312 00000100:00100000:3.0:1788305963.869519:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305963.869538:0:23464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015372800 00000100:00100000:2.0:1788305963.869542:0:23464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015372800 00000100:00100000:3.0:1788305963.869558:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788305963.869565:0:23464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788305963.869569:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015373312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305963.869570:0:23464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015372800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305963.869632:0:23464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015372800:12345-0@lo:400:kworker.0 Request processed in 59us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305963.869640:0:23464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788305963.869666:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015373696 00000100:00100000:2.0:1788305963.869670:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015373696 00000100:00100000:2.0:1788305963.869694:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015373824 00000100:00100000:2.0:1788305963.869697:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015373824 00000100:00100000:2.0:1788305963.869725:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015373952 00000100:00100000:2.0:1788305963.869728:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015373952 00000100:00100000:2.0:1788305963.869743:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788305963.869749:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015373696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305963.869782:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015373696:12345-0@lo:400:kworker.0 Request processed in 33us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305963.869788:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788305963.869799:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788305963.869816:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015373824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305963.869843:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015373824:12345-0@lo:400:kworker.0 Request processed in 30us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305963.869849:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788305963.869860:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788305963.869865:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015373952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305963.869984:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015373312:12345-0@lo:400:kworker.0 Request processed in 63us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305963.869993:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788305963.870024:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015372928:0@lo:8:kworker.0 00000100:00100000:3.0:1788305963.870063:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305963.870105:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015373056:0@lo:8:kworker.0 00000100:00100000:3.0:1788305963.870133:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305963.870151:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015373568:0@lo:8:kworker.0 00000100:00100000:3.0:1788305963.870174:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305963.870233:0:24697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015372928 00000100:00100000:3.0:1788305963.870238:0:24697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015372928 00000100:00100000:3.0:1788305963.870299:0:24697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015373056 00000100:00100000:3.0:1788305963.870303:0:24697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015373056 00000100:00100000:3.0:1788305963.870312:0:24697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015373568 00000100:00100000:3.0:1788305963.870314:0:24697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015373568 00000100:00100000:3.0:1788305963.870326:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788305963.870332:0:24697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875174015372928:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788305963.870711:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015373952:12345-0@lo:400:kworker.0 Request processed in 843us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305963.870718:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788305963.870775:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb357100 x1875174015373824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305963.870791:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015373824:0@lo:400:kworker.0 00010000:00080000:3.0:1788305963.870904:0:24697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 793 last 0 00000100:00100000:0.0:1788305963.870931:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788305963.870941:0:24697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4a426866e60551d0 00002000:00100000:3.0:1788305963.870958:0:24697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff88918c9a4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788305963.870963:0:24697:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788305963.870967:0:24697:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788305963.870974:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788305963.870981:0:24232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875174015373056:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788305963.871004:0:24232:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788305963.871043:0:24232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875174015373056:12345-0@lo:8:kworker.0 Request processed in 63us (910us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788305963.871050:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788305963.871062:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305963.871065:0:24232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875174015373568:12345-0@lo:8:kworker.0 00002000:00080000:3.0:1788305963.871068:0:24697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00010000:00020000:0.0:1788305963.871074:0:24232:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788305963.871095:0:24232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875174015373568:12345-0@lo:8:kworker.0 Request processed in 28us (920us total) trans 0 rc -19/-19 00000100:00080000:3.0:1788305963.871098:0:24697:0:(import.c:65:import_set_state_nolock()) ffff88918c9a0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305963.871100:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788305963.871114:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305963.871119:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305963.871134:0:24697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1875174015372928:12345-0@lo:8:kworker.0 Request processed in 802us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305963.871139:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788305963.871165:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015373184 00000100:00100000:3.0:1788305963.871170:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015373184 00000100:00100000:2.0:1788305963.871195:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015372800:0@lo:400:kworker.0 00000100:00100000:3.0:1788305963.871203:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788305963.871210:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015373184:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788305963.871212:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb356a00 x1875174015373696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305963.871221:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015373696:0@lo:400:kworker.0 00000100:00100000:3.0:1788305963.871263:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015373184:12345-0@lo:400:kworker.0 Request processed in 53us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305963.871269:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788305963.871304:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015373312:0@lo:400:kworker.0 00010000:00080000:2.0:1788305963.871316:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb354380 x1875174015373952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305963.871325:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015373952:0@lo:400:kworker.0 00010000:00080000:2.0:1788305963.871355:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889188560000 x1875174015372928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788305988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305963.871363:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788305963.871377:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788305963.871386:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788305963.871393:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788305963.871395:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bb1ed800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788305963.871408:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788305963.871414:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015372928:0@lo:8:kworker.0 00000100:00080000:2.0:1788305963.871447:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908353f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788305963.871453:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788305963.871456:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015373056:0@lo:8:kworker.0 00000100:00080000:2.0:1788305963.871470:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908273d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788305963.871474:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788305963.871477:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015373568:0@lo:8:kworker.0 00010000:00080000:2.0:1788305963.871516:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb357800 x1875174015373184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305963.871525:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015373184:0@lo:400:kworker.0 00000004:00080000:0.0:1788305963.871644:0:22746:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:0.0:1788305963.871669:0:22746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb37b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22746:1875174015374208:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788305963.871706:0:22746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305963.871724:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af2700c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788305963.871742:0:22745:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788305963.871918:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305963.871928:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015374080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305963.871958:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788305963.872040:0:22745:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793962763708ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788305963.872047:0:22745:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788305963.872112:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015374208 00000100:00100000:0.0:1788305963.872117:0:24232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015374208 00000100:00100000:0.0:1788305963.872156:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305963.872164:0:24232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22746:x1875174015374208:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788305963.872729:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015374080 00000100:00100000:3.0:1788305963.872735:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015374080 00000100:00100000:3.0:1788305963.872768:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305963.872775:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875174015374080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788305963.872805:0:24234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788305963.872864:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875174015374080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305963.872881:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788305963.872932:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891afb37100 x1875174015374080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305963.872951:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015374080:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1788305963.874332:0:22702:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00080000:0.0:1788305963.876548:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305963.879048:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305963.879515:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015373440:0@lo:400:kworker.0 00000100:00100000:1.0:1788305963.879572:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305963.879883:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015372672 00000100:00100000:3.0:1788305963.879896:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015372672 00000100:00100000:3.0:1788305963.880012:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788305963.880026:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083098450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:3650:x1875174015372672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305963.880110:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083098450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:3650:x1875174015372672:12345-0@lo:400:kworker.0 Request processed in 87us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305963.880119:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788305963.880501:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4402ecd-e8a2-4271-82d7-771a7bb97982:3650:1875174015372672:0@lo:400:kworker.0 00000100:00100000:0.0:1788305963.881349:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015373440 00000100:00100000:0.0:1788305963.881359:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015373440 00000100:00100000:0.0:1788305963.881430:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305963.881438:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015373440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305963.881513:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015373440:12345-0@lo:400:kworker.0 Request processed in 76us (1941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305963.881519:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788305963.881539:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788305963.881754:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb356680 x1875174015373440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305963.881770:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015373440:0@lo:400:kworker.0 00002000:00080000:1.0:1788305963.882176:0:24232:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788305963.882185:0:24232:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:1.0:1788305963.882204:0:24232:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00002000:00010000:1.0:1788305963.896722:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788305963.896739:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e05dcbd5/0x4a426866e60551d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.896773:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788305963.896778:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305963.896786:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e05dcbd5/0x4a426866e60551d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.896809:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e05dcbd5/0x4a426866e60551d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.896823:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e05dcbd5/0x4a426866e60551d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.896832:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e05dcbd5/0x4a426866e60551d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.896861:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305963.896901:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305963.896910:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e05dcbd5/0x4a426866e60551d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.896919:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7de400 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305963.896924:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e05dcbd5/0x4a426866e60551d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.896933:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e05dcbd5/0x4a426866e60551d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.896955:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e05dcbd5/0x4a426866e60551d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.896963:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e05dcbd5/0x4a426866e60551d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.896981:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.896983:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.896985:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305963.901809:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788305963.901827:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6a0ed40/0x4a426866e60551de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.901848:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788305963.901854:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305963.901862:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6a0ed40/0x4a426866e60551de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.901892:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6a0ed40/0x4a426866e60551de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.901917:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6a0ed40/0x4a426866e60551de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.901926:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6a0ed40/0x4a426866e60551de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.901988:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788305963.902674:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788305963.902682:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5e6bdad/0x4a426866e60551e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.902695:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788305963.902699:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305963.902704:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5e6bdad/0x4a426866e60551e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.902716:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5e6bdad/0x4a426866e60551e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.902725:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5e6bdad/0x4a426866e60551e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.902733:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5e6bdad/0x4a426866e60551e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.902843:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788305963.902853:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6a0ed40/0x4a426866e60551de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.902861:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7de800 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305963.902866:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6a0ed40/0x4a426866e60551de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.902886:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6a0ed40/0x4a426866e60551de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.902911:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6a0ed40/0x4a426866e60551de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.902925:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6a0ed40/0x4a426866e60551de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.902971:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305963.903118:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1788305963.907129:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788305963.907152:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7bd7487/0x4a426866e60551ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.907177:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788305963.907182:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305963.907190:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7bd7487/0x4a426866e60551ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.907208:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7bd7487/0x4a426866e60551ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.907221:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7bd7487/0x4a426866e60551ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.907229:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7bd7487/0x4a426866e60551ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.907242:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788305963.907919:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788305963.907926:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000901b2c86/0x4a426866e60551f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.907937:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788305963.907947:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305963.907952:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000901b2c86/0x4a426866e60551f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.907963:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000901b2c86/0x4a426866e60551f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.907971:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000901b2c86/0x4a426866e60551f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.907979:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000901b2c86/0x4a426866e60551f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.907989:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788305963.908339:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788305963.908345:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5f332bc/0x4a426866e60551fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.908416:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788305963.908420:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305963.908425:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5f332bc/0x4a426866e60551fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.908437:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5f332bc/0x4a426866e60551fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.908446:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5f332bc/0x4a426866e60551fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.908459:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5f332bc/0x4a426866e60551fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.908467:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788305963.908748:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788305963.908755:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000436589c2/0x4a426866e6055201 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.908764:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788305963.908768:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305963.908772:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000436589c2/0x4a426866e6055201 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.908782:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000436589c2/0x4a426866e6055201 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.908790:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000436589c2/0x4a426866e6055201 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.908798:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000436589c2/0x4a426866e6055201 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.908807:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788305963.909425:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788305963.909435:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045a88a06/0x4a426866e6055208 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.909454:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788305963.909457:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305963.909463:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045a88a06/0x4a426866e6055208 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.909474:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045a88a06/0x4a426866e6055208 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.909483:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045a88a06/0x4a426866e6055208 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.909491:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045a88a06/0x4a426866e6055208 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.909501:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788305963.910889:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788305963.910904:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a132ac2e/0x4a426866e605520f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.910921:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788305963.910926:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305963.910933:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a132ac2e/0x4a426866e605520f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.910947:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a132ac2e/0x4a426866e605520f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.910975:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a132ac2e/0x4a426866e605520f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.910985:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a132ac2e/0x4a426866e605520f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.910995:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1788305963.911203:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788305963.911213:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7bd7487/0x4a426866e60551ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.911221:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7de000 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305963.911227:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7bd7487/0x4a426866e60551ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.911237:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7bd7487/0x4a426866e60551ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.911258:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7bd7487/0x4a426866e60551ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.911265:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7bd7487/0x4a426866e60551ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.911297:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788305963.911301:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000901b2c86/0x4a426866e60551f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.911308:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7dfe00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305963.911321:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000901b2c86/0x4a426866e60551f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.911329:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000901b2c86/0x4a426866e60551f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.911340:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000901b2c86/0x4a426866e60551f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.911347:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000901b2c86/0x4a426866e60551f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.911491:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788305963.911495:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5f332bc/0x4a426866e60551fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.911502:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7de200 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305963.911505:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5f332bc/0x4a426866e60551fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.911514:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5f332bc/0x4a426866e60551fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.911525:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5f332bc/0x4a426866e60551fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.911533:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5f332bc/0x4a426866e60551fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.911552:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788305963.911556:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000436589c2/0x4a426866e6055201 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.911563:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7df600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305963.911567:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000436589c2/0x4a426866e6055201 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.911574:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000436589c2/0x4a426866e6055201 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.911582:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000436589c2/0x4a426866e6055201 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.911590:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000436589c2/0x4a426866e6055201 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.911600:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788305963.911603:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045a88a06/0x4a426866e6055208 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.911610:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7dee00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305963.911613:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045a88a06/0x4a426866e6055208 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.911630:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045a88a06/0x4a426866e6055208 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788305963.912474:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788305963.912485:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000911fce86/0x4a426866e6055216 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.912502:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788305963.912506:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305963.912512:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000911fce86/0x4a426866e6055216 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.912526:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000911fce86/0x4a426866e6055216 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.912536:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000911fce86/0x4a426866e6055216 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.912545:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000911fce86/0x4a426866e6055216 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.912568:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788305963.912943:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045a88a06/0x4a426866e6055208 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.912952:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045a88a06/0x4a426866e6055208 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.912975:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788305963.912980:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a132ac2e/0x4a426866e605520f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.912986:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7df000 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305963.912990:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a132ac2e/0x4a426866e605520f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.912999:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a132ac2e/0x4a426866e605520f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.913008:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a132ac2e/0x4a426866e605520f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.913014:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a132ac2e/0x4a426866e605520f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.913038:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305963.913041:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000911fce86/0x4a426866e6055216 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.913048:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7dea00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305963.913051:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000911fce86/0x4a426866e6055216 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.913058:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000911fce86/0x4a426866e6055216 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.913067:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000911fce86/0x4a426866e6055216 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.913074:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000911fce86/0x4a426866e6055216 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.913093:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305963.913095:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305963.913098:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305963.913586:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788305963.913594:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cb5e208/0x4a426866e605521d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.913607:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=793s v=(0 0) 00010000:00010000:1.0:1788305963.913610:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305963.913617:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cb5e208/0x4a426866e605521d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.913628:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cb5e208/0x4a426866e605521d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.913764:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cb5e208/0x4a426866e605521d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.913774:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cb5e208/0x4a426866e605521d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.913959:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305963.916572:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305963.916586:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cb5e208/0x4a426866e605521d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.916603:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7dfa00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305963.916609:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cb5e208/0x4a426866e605521d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.916621:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cb5e208/0x4a426866e605521d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.916651:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cb5e208/0x4a426866e605521d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.916659:0:24891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cb5e208/0x4a426866e605521d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.916688:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5e6bdad/0x4a426866e60551e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.916696:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7dfc00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305963.916699:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5e6bdad/0x4a426866e60551e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.916706:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5e6bdad/0x4a426866e60551e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.916730:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5e6bdad/0x4a426866e60551e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.916738:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5e6bdad/0x4a426866e60551e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.916763:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.916765:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.916768:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.916773:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.916774:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.916776:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.917391:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305963.917935:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788305963.917949:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d10fee8/0x4a426866e6055224 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.917968:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=794s v=(0 0) 00010000:00010000:1.0:1788305963.917987:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305963.917995:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d10fee8/0x4a426866e6055224 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.918014:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d10fee8/0x4a426866e6055224 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.918025:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d10fee8/0x4a426866e6055224 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.918032:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d10fee8/0x4a426866e6055224 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.918062:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305963.918152:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305963.918159:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d10fee8/0x4a426866e6055224 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.918167:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7df800 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305963.918171:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d10fee8/0x4a426866e6055224 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.918179:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d10fee8/0x4a426866e6055224 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.918196:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d10fee8/0x4a426866e6055224 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.918218:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d10fee8/0x4a426866e6055224 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.918238:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.918241:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.918243:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305963.919521:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788305963.919534:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e05dcbd5/0x4a426866e605522b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.919551:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=794s v=(0 0) 00010000:00010000:1.0:1788305963.919555:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305963.919561:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e05dcbd5/0x4a426866e605522b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.919573:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e05dcbd5/0x4a426866e605522b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.919582:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e05dcbd5/0x4a426866e605522b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.919598:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e05dcbd5/0x4a426866e605522b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.919625:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305963.922242:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305963.922258:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e05dcbd5/0x4a426866e605522b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.922288:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7de400 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305963.922293:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e05dcbd5/0x4a426866e605522b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.922305:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e05dcbd5/0x4a426866e605522b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.922330:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e05dcbd5/0x4a426866e605522b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.922339:0:24891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e05dcbd5/0x4a426866e605522b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.922364:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.922365:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.922367:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788305963.924305:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305963.924323:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000341502fa/0x4a426866e6055232 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.924344:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=794s v=(0 0) 00010000:00010000:0.0:1788305963.924350:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305963.924357:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000341502fa/0x4a426866e6055232 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.924372:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000341502fa/0x4a426866e6055232 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.924383:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000341502fa/0x4a426866e6055232 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.924391:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000341502fa/0x4a426866e6055232 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.924413:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788305963.924534:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305963.924543:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000341502fa/0x4a426866e6055232 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.924550:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523be00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305963.924564:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000341502fa/0x4a426866e6055232 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.924573:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000341502fa/0x4a426866e6055232 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.924592:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000341502fa/0x4a426866e6055232 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.924598:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000341502fa/0x4a426866e6055232 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.924617:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305963.924619:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305963.924620:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788305963.925425:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305963.925437:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e1bda5f/0x4a426866e6055239 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.925452:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=794s v=(0 0) 00010000:00010000:0.0:1788305963.925456:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305963.925462:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e1bda5f/0x4a426866e6055239 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.925486:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e1bda5f/0x4a426866e6055239 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.925496:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e1bda5f/0x4a426866e6055239 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.925504:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e1bda5f/0x4a426866e6055239 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.925522:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305963.925666:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305963.925672:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e1bda5f/0x4a426866e6055239 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.925681:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523b600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305963.925684:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e1bda5f/0x4a426866e6055239 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.925693:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e1bda5f/0x4a426866e6055239 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.925710:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e1bda5f/0x4a426866e6055239 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.925718:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e1bda5f/0x4a426866e6055239 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.925741:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.925743:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.925745:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788305963.926001:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305963.926007:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a9a2c7b/0x4a426866e6055240 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.926017:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=794s v=(0 0) 00010000:00010000:0.0:1788305963.926021:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305963.926025:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a9a2c7b/0x4a426866e6055240 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.926035:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a9a2c7b/0x4a426866e6055240 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.926044:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a9a2c7b/0x4a426866e6055240 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.926051:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a9a2c7b/0x4a426866e6055240 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.926066:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305963.926184:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305963.926190:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a9a2c7b/0x4a426866e6055240 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.926209:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523ba00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305963.926213:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a9a2c7b/0x4a426866e6055240 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.926221:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a9a2c7b/0x4a426866e6055240 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.926234:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a9a2c7b/0x4a426866e6055240 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.926240:0:24891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a9a2c7b/0x4a426866e6055240 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.926253:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.926255:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.926257:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788305963.927237:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305963.927249:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6055247 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.927266:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=794s v=(0 0) 00010000:00010000:0.0:1788305963.927270:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305963.927301:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6055247 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.927315:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6055247 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.927333:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6055247 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.927340:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6055247 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.927357:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305963.927540:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305963.927547:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6055247 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.927555:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8c00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305963.927560:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6055247 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.927569:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6055247 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.927584:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6055247 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.927592:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6055247 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.927610:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.927618:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.927620:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788305963.928045:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305963.928051:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc43caea/0x4a426866e605524e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.928062:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=794s v=(0 0) 00010000:00010000:0.0:1788305963.928065:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305963.928070:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc43caea/0x4a426866e605524e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.928150:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc43caea/0x4a426866e605524e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.928160:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc43caea/0x4a426866e605524e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.928168:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc43caea/0x4a426866e605524e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.928194:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305963.928377:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305963.928385:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc43caea/0x4a426866e605524e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.928393:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9400 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305963.928396:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc43caea/0x4a426866e605524e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.928404:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc43caea/0x4a426866e605524e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.928418:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc43caea/0x4a426866e605524e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.928425:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc43caea/0x4a426866e605524e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.928442:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305963.928443:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305963.928445:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788305963.929296:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305963.929307:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a462779c/0x4a426866e6055255 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.929320:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=794s v=(0 0) 00010000:00010000:0.0:1788305963.929324:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305963.929330:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a462779c/0x4a426866e6055255 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.929349:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a462779c/0x4a426866e6055255 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.929359:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a462779c/0x4a426866e6055255 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.929366:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a462779c/0x4a426866e6055255 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.929391:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788305963.929425:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305963.929433:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a462779c/0x4a426866e6055255 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.929440:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9a00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305963.929444:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a462779c/0x4a426866e6055255 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.929453:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a462779c/0x4a426866e6055255 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.929468:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a462779c/0x4a426866e6055255 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.929480:0:24891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a462779c/0x4a426866e6055255 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.929497:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305963.929499:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305963.929500:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788305963.931410:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305963.931428:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000781e1cd5/0x4a426866e605525c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.931448:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=794s v=(0 0) 00010000:00010000:0.0:1788305963.931452:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305963.931461:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000781e1cd5/0x4a426866e605525c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.931475:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000781e1cd5/0x4a426866e605525c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.931486:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000781e1cd5/0x4a426866e605525c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.931509:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000781e1cd5/0x4a426866e605525c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.931534:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788305963.931590:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305963.931598:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000781e1cd5/0x4a426866e605525c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.931607:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8e00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305963.931612:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000781e1cd5/0x4a426866e605525c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.931621:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000781e1cd5/0x4a426866e605525c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.931709:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000781e1cd5/0x4a426866e605525c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.931717:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000781e1cd5/0x4a426866e605525c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.931736:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305963.931738:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305963.931740:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788305963.934134:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305963.934153:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2307468/0x4a426866e6055263 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.934174:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=794s v=(0 0) 00010000:00010000:2.0:1788305963.934178:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305963.934197:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2307468/0x4a426866e6055263 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.934215:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2307468/0x4a426866e6055263 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.934226:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2307468/0x4a426866e6055263 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.934233:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2307468/0x4a426866e6055263 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.934593:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788305963.936353:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305963.936371:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e605526a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.936393:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=794s v=(0 0) 00010000:00010000:0.0:1788305963.936398:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305963.936405:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e605526a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.936422:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e605526a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.936434:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e605526a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.936442:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e605526a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.941101:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788305963.941140:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2307468/0x4a426866e6055263 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.941159:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb000 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305963.941165:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2307468/0x4a426866e6055263 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.941179:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2307468/0x4a426866e6055263 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.941209:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2307468/0x4a426866e6055263 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.941218:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2307468/0x4a426866e6055263 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.941243:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305963.941247:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e605526a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.941254:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8c00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305963.941258:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e605526a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.941265:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e605526a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.941304:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e605526a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.941313:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305963.941315:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305963.941317:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.942669:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788305963.942684:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e605526a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.946666:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788305963.947259:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305963.947272:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003374892c/0x4a426866e6055271 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.947325:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=794s v=(0 0) 00010000:00010000:2.0:1788305963.947330:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305963.947338:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003374892c/0x4a426866e6055271 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.947354:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003374892c/0x4a426866e6055271 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.947367:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003374892c/0x4a426866e6055271 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.947382:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003374892c/0x4a426866e6055271 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.947404:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305963.947732:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305963.947741:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003374892c/0x4a426866e6055271 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.947751:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebc00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305963.947756:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003374892c/0x4a426866e6055271 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.947766:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003374892c/0x4a426866e6055271 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.947786:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003374892c/0x4a426866e6055271 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.947794:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003374892c/0x4a426866e6055271 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.947826:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.947828:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.947830:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788305963.949002:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305963.949016:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f85461d1/0x4a426866e6055278 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.949035:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=794s v=(0 0) 00010000:00010000:2.0:1788305963.949039:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305963.949045:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f85461d1/0x4a426866e6055278 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.949058:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f85461d1/0x4a426866e6055278 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.949067:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f85461d1/0x4a426866e6055278 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.949074:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f85461d1/0x4a426866e6055278 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.949105:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305963.949342:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305963.949350:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f85461d1/0x4a426866e6055278 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.949359:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eae00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305963.949370:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f85461d1/0x4a426866e6055278 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.949378:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f85461d1/0x4a426866e6055278 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.949396:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f85461d1/0x4a426866e6055278 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.949404:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f85461d1/0x4a426866e6055278 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.949425:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.949427:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.949429:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788305963.951789:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305963.951809:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3c16b4b/0x4a426866e605527f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.951839:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=794s v=(0 0) 00010000:00010000:2.0:1788305963.951844:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305963.951851:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3c16b4b/0x4a426866e605527f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.951867:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3c16b4b/0x4a426866e605527f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.951893:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3c16b4b/0x4a426866e605527f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.951900:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3c16b4b/0x4a426866e605527f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.951931:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788305963.953349:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305963.953366:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3c16b4b/0x4a426866e605527f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.953380:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea000 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305963.953386:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3c16b4b/0x4a426866e605527f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.953397:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3c16b4b/0x4a426866e605527f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.953422:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3c16b4b/0x4a426866e605527f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.953430:0:24891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3c16b4b/0x4a426866e605527f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.953454:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305963.953456:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305963.953458:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788305963.955531:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305963.955547:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6055286 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.955571:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=794s v=(0 0) 00010000:00010000:0.0:1788305963.955577:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305963.955585:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6055286 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.955602:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6055286 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.955614:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6055286 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.955629:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6055286 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.955661:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788305963.958374:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305963.958394:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f73f17d/0x4a426866e605528d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.958418:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=794s v=(0 0) 00010000:00010000:0.0:1788305963.958423:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305963.958430:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f73f17d/0x4a426866e605528d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.958445:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f73f17d/0x4a426866e605528d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.958456:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f73f17d/0x4a426866e605528d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.958464:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f73f17d/0x4a426866e605528d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.958485:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788305963.958499:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788305963.958506:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6055286 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.958526:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8c00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305963.958531:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6055286 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.958542:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6055286 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.958564:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6055286 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.958572:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6055286 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.958593:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305963.958597:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f73f17d/0x4a426866e605528d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.958604:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8a00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305963.958608:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f73f17d/0x4a426866e605528d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.958615:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f73f17d/0x4a426866e605528d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.958626:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f73f17d/0x4a426866e605528d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.958639:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f73f17d/0x4a426866e605528d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.958654:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.958656:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.958657:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305963.959254:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788305963.960099:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305963.960113:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fab0aba/0x4a426866e6055294 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.960132:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=794s v=(0 0) 00010000:00010000:0.0:1788305963.960136:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305963.960143:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fab0aba/0x4a426866e6055294 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.960157:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fab0aba/0x4a426866e6055294 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.960168:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fab0aba/0x4a426866e6055294 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.960176:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fab0aba/0x4a426866e6055294 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.961083:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788305963.965323:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305963.965351:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016e29426/0x4a426866e605529b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.965373:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=794s v=(0 0) 00010000:00010000:0.0:1788305963.965379:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305963.965386:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016e29426/0x4a426866e605529b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.965405:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016e29426/0x4a426866e605529b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.965417:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016e29426/0x4a426866e605529b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.965425:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016e29426/0x4a426866e605529b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.965495:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788305963.965506:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fab0aba/0x4a426866e6055294 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.965515:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9200 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305963.965520:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fab0aba/0x4a426866e6055294 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.965543:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fab0aba/0x4a426866e6055294 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.965566:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fab0aba/0x4a426866e6055294 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.965574:0:24891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fab0aba/0x4a426866e6055294 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.965598:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305963.965601:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016e29426/0x4a426866e605529b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.965608:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8200 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305963.965611:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016e29426/0x4a426866e605529b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.965619:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016e29426/0x4a426866e605529b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.965630:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016e29426/0x4a426866e605529b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305963.965637:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305963.965639:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305963.965646:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305963.972165:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788305963.972186:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016e29426/0x4a426866e605529b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.972626:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788305963.973007:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305963.973018:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a711d3e5/0x4a426866e60552a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.973035:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=794s v=(0 0) 00010000:00010000:0.0:1788305963.973040:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305963.973055:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a711d3e5/0x4a426866e60552a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.973086:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a711d3e5/0x4a426866e60552a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.973098:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a711d3e5/0x4a426866e60552a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.973114:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a711d3e5/0x4a426866e60552a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.973137:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305963.973207:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305963.973215:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a711d3e5/0x4a426866e60552a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.973225:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305963.973231:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a711d3e5/0x4a426866e60552a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.973241:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a711d3e5/0x4a426866e60552a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.973263:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a711d3e5/0x4a426866e60552a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.973272:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a711d3e5/0x4a426866e60552a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.973317:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305963.973326:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305963.973328:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788305963.973954:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305963.973963:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1feeaad/0x4a426866e60552a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.973977:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=794s v=(0 0) 00010000:00010000:0.0:1788305963.973981:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305963.973986:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1feeaad/0x4a426866e60552a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.973998:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1feeaad/0x4a426866e60552a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.974006:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1feeaad/0x4a426866e60552a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.974028:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1feeaad/0x4a426866e60552a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.974057:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788305963.974381:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305963.974389:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1feeaad/0x4a426866e60552a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.974398:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9800 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305963.974403:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1feeaad/0x4a426866e60552a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.974412:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1feeaad/0x4a426866e60552a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.974443:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1feeaad/0x4a426866e60552a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.974452:0:24891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1feeaad/0x4a426866e60552a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305963.974473:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305963.974476:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305963.974478:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788305963.975536:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305963.975547:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000201dc856/0x4a426866e60552b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.975563:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=794s v=(0 0) 00010000:00010000:0.0:1788305963.975567:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305963.975573:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000201dc856/0x4a426866e60552b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.975587:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000201dc856/0x4a426866e60552b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.975596:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000201dc856/0x4a426866e60552b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.975604:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000201dc856/0x4a426866e60552b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305963.975628:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305963.975835:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305963.975843:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000201dc856/0x4a426866e60552b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.975852:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8000 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305963.975857:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000201dc856/0x4a426866e60552b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.975866:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000201dc856/0x4a426866e60552b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.975895:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000201dc856/0x4a426866e60552b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.975903:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000201dc856/0x4a426866e60552b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305963.975926:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305963.975928:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305963.975930:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788305963.975933:0:24232:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1788305963.976076:0:24232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22746:x1875174015374208:12345-0@lo:5:osp-pre-0-0.0 Request processed in 103905us (104362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305963.976092:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788305963.976393:0:22746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb37b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22746:1875174015374208:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788305963.976414:0:22746:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:1.0:1788305963.976472:0:22746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22746:1875174015374336:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788305963.976518:0:22746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305963.976562:0:22746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891834ef840 going to sleep for 11 seconds 00000100:00100000:2.0:1788305963.976616:0:24697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015374336 00000100:00100000:2.0:1788305963.976623:0:24697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015374336 00000100:00100000:2.0:1788305963.976678:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788305963.976689:0:24697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22746:x1875174015374336:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788305963.976735:0:24697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:2.0:1788305963.983991:0:24227:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1788305963.984055:0:24227:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788305963.984566:0:24697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22746:x1875174015374336:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7871us (8040us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788305963.984581:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788305963.984919:0:22746:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1788305963.984932:0:22746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22746:1875174015374336:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788305963.984955:0:22746:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000100:00100000:3.0:1788305963.996018:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015374464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305963.996132:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305963.996220:0:23464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015374464 00000100:00100000:3.0:1788305963.996230:0:23464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015374464 00000100:00100000:3.0:1788305963.996308:0:23464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788305963.996319:0:23464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015374464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788305963.996362:0:23464:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788305963.996414:0:23464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015374464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305963.996423:0:23464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788305963.996500:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015374464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305964.501577:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015374592:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305964.501681:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305964.502032:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015374592 00000100:00100000:0.0:1788305964.502044:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015374592 00000100:00100000:0.0:1788305964.502117:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788305964.502130:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015374592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788305964.502181:0:22726:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788305964.502316:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015374592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305964.502329:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788305964.502387:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015374592:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788305964.757550:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305965.014178:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015374720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788305965.014250:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305965.014335:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015374720 00000100:00100000:1.0:1788305965.016463:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015374720 00000100:00100000:1.0:1788305965.016603:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788305965.016617:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015374720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788305965.016660:0:24234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788305965.016742:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015374720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (2491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305965.016750:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788305965.016817:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015374720:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788305965.018733:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788305965.272169:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788305965.782264:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788305966.690348:0:25047:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788305966.690352:0:25047:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788305966.690353:0:25047:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788305966.690463:0:25047:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88908259c800 00000020:01000004:2.0:1788305966.690479:0:25047:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788305966.690495:0:25047:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788305966.690509:0:25047:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff889186270000) 00000020:00000080:2.0:1788305966.690526:0:25047:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788305966.741080:0:25047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788305966.742783:0:25047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788305966.743317:0:25047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788305966.743614:0:25047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788305966.744201:0:25047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788305966.745028:0:25047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788305966.745236:0:25047:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1788305966.749049:0:25047:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788305966.749267:0:25047:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788305966.749518:0:25047:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788305966.749533:0:25047:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4a426866e60552be 00000020:01000004:0.0:1788305966.749540:0:25047:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788305966.749564:0:25047:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.155@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788305966.749567:0:25047:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788305966.749575:0:25047:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788305966.749604:0:25047:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788305966.749618:0:25047:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.155@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788305966.777527:0:25047:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.155@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788305966.777570:0:25047:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.155@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788305966.777579:0:25047:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788305966.777580:0:25047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788305966.777581:0:25047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305966.777582:0:25047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305966.777583:0:25047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305966.777584:0:25047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305966.777585:0:25047:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788305966.777587:0:25047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305966.777588:0:25047:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788305966.777592:0:25047:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788305966.777594:0:25047:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788305966.777595:0:25047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788305966.777596:0:25047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305966.777597:0:25047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305966.777597:0:25047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305966.777598:0:25047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305966.777599:0:25047:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788305966.777600:0:25047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305966.777601:0:25047:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788305966.777796:0:25047:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788305966.777815:0:25047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9916300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015374848:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788305966.777896:0:25047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305966.778004:0:25047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891863e3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788305966.778045:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015374848 00000100:00100000:1.0:1788305966.778053:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015374848 00000100:00100000:1.0:1788305966.778143:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788305966.778162:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083098050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:25047:x1875174015374848:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788305966.778193:0:22715:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788305966.778197:0:22715:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788305966.778201:0:22715:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788305966.782813:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083098050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:25047:x1875174015374848:12345-0@lo:253:mount.lustre.0 Request processed in 4644us (4908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305966.782828:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788305966.782957:0:25047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9916300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015374848:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788305966.782972:0:25047:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788305966.782976:0:25047:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788305966.782977:0:25047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788305966.782978:0:25047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305966.782980:0:25047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305966.782981:0:25047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305966.782982:0:25047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305966.782984:0:25047:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788305966.782986:0:25047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305966.782987:0:25047:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788305966.783013:0:25047:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88908259c800 from lustre-OST0001 10000000:01000000:2.0:1788305966.783042:0:25047:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788305966.783044:0:25047:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788305966.783067:0:25047:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff889184028000 local copy 00010000:00010000:2.0:1788305966.783078:0:25047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054ef1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054ef8 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305966.783186:0:25047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9916300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015374976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305966.783225:0:25047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305966.783263:0:25047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891863e3240 going to sleep for 11 seconds 00000100:00100000:0.0:1788305966.783822:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015374976 00000100:00100000:0.0:1788305966.783831:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015374976 00000100:00100000:0.0:1788305966.783887:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788305966.783898:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083099050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:25047:x1875174015374976:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305966.783979:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083099050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:25047:x1875174015374976:12345-0@lo:501:mount.lustre.0 Request processed in 83us (754us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788305966.783995:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788305966.784128:0:25047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9916300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015374976:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788305966.784149:0:25047:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788305966.784171:0:25047:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788305966.784178:0:25047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054ef1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054ef8 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305966.784187:0:25047:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054ef1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054ef8 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305966.784212:0:25047:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88908259c800 10000000:01000000:1.0:1788305966.784217:0:25047:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788305966.784221:0:25047:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788305966.784224:0:25047:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788305966.784228:0:25047:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788305966.784230:0:25047:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788305966.784255:0:25047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff88919d7dfe00/0x4a426866e60552c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305966.784264:0:25047:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff88919d7dfe00/0x4a426866e60552c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305966.784303:0:25047:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff88919d7dfe00/0x4a426866e60552c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305966.784336:0:25047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015375104:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788305966.784905:0:25047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305966.784938:0:25047:0:(client.c:2715:ptlrpc_set_wait()) set ffff889182f61a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305966.785035:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015375104 00000100:00100000:2.0:1788305966.785041:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015375104 00000100:00100000:2.0:1788305966.785115:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788305966.785125:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908309bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:25047:x1875174015375104:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788305966.785135:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305966.785150:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891bb3ebc00/0x4a426866e60552cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60552c5 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305966.785172:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3ebc00/0x4a426866e60552cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60552c5 expref: 22 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305966.785183:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891bb3ebc00/0x4a426866e60552cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60552c5 expref: 22 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305966.785192:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ebc00, rc 0) 00000100:00100000:2.0:1788305966.785237:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908309bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+22:25047:x1875174015375104:12345-0@lo:101:mount.lustre.0 Request processed in 114us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305966.785244:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788305966.785314:0:25047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015375104:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788305966.785340:0:25047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff88919d7dfe00/0x4a426866e60552c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60552cc expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305966.785349:0:25047:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff88919d7dfe00/0x4a426866e60552c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60552cc expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788305966.787651:0:25047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1788305966.788662:0:25047:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788305966.791555:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788305966.791995:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788305966.792022:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788305966.792043:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788305966.792080:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788305966.792097:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788305966.792113:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788305966.792578:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788305966.792601:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1788305966.793100:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1788305966.793111:0:25047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1788305966.793231:0:25047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015375232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305966.793341:0:25047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305966.793388:0:25047:0:(client.c:2715:ptlrpc_set_wait()) set ffff889182f61c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305966.793488:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015375232 00000100:00100000:2.0:1788305966.793496:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015375232 00000100:00100000:2.0:1788305966.793552:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788305966.793562:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908309b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+22:25047:x1875174015375232:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305966.793746:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908309b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+22:25047:x1875174015375232:12345-0@lo:501:mount.lustre.0 Request processed in 185us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305966.793755:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788305966.794043:0:25047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015375232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305966.794086:0:25047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015375360:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788305966.794126:0:25047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305966.794150:0:25047:0:(client.c:2715:ptlrpc_set_wait()) set ffff889182f61c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305966.795332:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015375360 00000100:00100000:2.0:1788305966.795341:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015375360 00000100:00100000:2.0:1788305966.795406:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788305966.795415:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083099450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+22:25047:x1875174015375360:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788305966.797138:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083099450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+22:25047:x1875174015375360:12345-0@lo:503:mount.lustre.0 Request processed in 1707us (2993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305966.797150:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788305966.797331:0:25047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015375360:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788305966.797967:0:25047:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788305966.798049:0:25047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015375488:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305966.798108:0:25047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305966.798267:0:25047:0:(client.c:2715:ptlrpc_set_wait()) set ffff889182f61a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305966.801823:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015375488 00000100:00100000:0.0:1788305966.801839:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015375488 00000100:00100000:0.0:1788305966.802031:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788305966.802042:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908309a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+22:25047:x1875174015375488:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305966.802930:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908309a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+22:25047:x1875174015375488:12345-0@lo:502:mount.lustre.0 Request processed in 886us (4817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305966.802941:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788305966.803065:0:25047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015375488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788305966.803395:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788305966.803426:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788305966.803440:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788305966.803451:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788305966.803463:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788305966.803474:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788305966.803487:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788305966.803499:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788305966.803512:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1788305966.803547:0:25047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015375616:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305966.803594:0:25047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305966.816499:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015375616 00000100:00100000:1.0:1788305966.816513:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015375616 00000100:00100000:1.0:1788305966.816581:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788305966.816592:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083099c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+22:25047:x1875174015375616:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305966.816785:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083099c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+22:25047:x1875174015375616:12345-0@lo:502:mount.lustre.0 Request processed in 194us (13190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305966.816794:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00010000:1.0:1788305966.816912:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305966.820400:0:25047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2b20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305966.820449:0:25047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015375616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788305966.820567:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1788305966.820582:0:25047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788305966.826398:0:25051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788305966.826410:0:25051:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788305966.826417:0:25051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305966.826420:0:25051:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788305966.826426:0:25051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788305966.826449:0:25051:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff889186273370) 00000020:00000080:2.0:1788305966.826477:0:25051:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788305966.826484:0:25051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788305966.826567:0:25051:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88908259c800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788305966.826576:0:25051:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788305966.826583:0:25051:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4a426866e60552da 00010000:00010000:2.0:1788305966.839141:0:25051:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1788305966.841573:0:25051:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:3.0:1788305966.845050:0:25051:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1788305966.847350:0:25051:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788305966.847368:0:25051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305966.847376:0:25051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305966.847379:0:25051:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788305966.847383:0:25051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305966.847387:0:25051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305966.847389:0:25051:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788305966.847391:0:25051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788305966.847393:0:25051:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788305966.847395:0:25051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305966.847397:0:25051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305966.847398:0:25051:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788305966.847409:0:25051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305966.847411:0:25051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305966.847413:0:25051:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788305966.847416:0:25051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788305966.847446:0:25051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305966.847449:0:25051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305966.847450:0:25051:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788305966.847453:0:25051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1788305966.847737:0:25047:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788305966.847767:0:25047:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788305966.847783:0:25047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff88919d7dfe00/0x4a426866e60552c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60552cc expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305966.847795:0:25047:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff88919d7dfe00/0x4a426866e60552c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60552cc expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305966.847811:0:25047:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88908259c800 from 1 10000000:01000000:3.0:1788305966.847813:0:25047:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788305966.847860:0:25047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181683600/0x4a426866e60552e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305966.847868:0:25047:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889181683600/0x4a426866e60552e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305966.847879:0:25047:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889181683600/0x4a426866e60552e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305966.847912:0:25047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015375744:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788305966.847980:0:25047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305966.848023:0:25047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4def00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305966.852893:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015375744 00000100:00100000:1.0:1788305966.852908:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015375744 00000100:00100000:1.0:1788305966.852964:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788305966.852974:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908309b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+22:25047:x1875174015375744:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788305966.852993:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305966.853013:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88919d7de000/0x4a426866e60552e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60552e1 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305966.853043:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88919d7de000/0x4a426866e60552e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60552e1 expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305966.853055:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88919d7de000/0x4a426866e60552e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60552e1 expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305966.853064:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88919d7de000, rc 0) 00000100:00100000:1.0:1788305966.853202:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908309b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+23:25047:x1875174015375744:12345-0@lo:101:mount.lustre.0 Request processed in 229us (5220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305966.853209:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788305966.853422:0:25047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015375744:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305966.853442:0:25047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889181683600/0x4a426866e60552e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60552e8 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.853451:0:25047:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889181683600/0x4a426866e60552e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60552e8 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788305966.856030:0:25047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1788305966.856539:0:25047:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788305966.857123:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788305966.857166:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788305966.857181:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788305966.857193:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788305966.857207:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788305966.857221:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788305966.857233:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788305966.857245:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788305966.857257:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788305966.857271:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1788305966.857317:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1788305966.857349:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1788305966.857354:0:25047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1788305966.857565:0:25047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015375872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305966.857645:0:25047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305966.857690:0:25047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890830703c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305966.857855:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015375872 00000100:00100000:2.0:1788305966.857863:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015375872 00000100:00100000:2.0:1788305966.857918:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788305966.857928:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908309a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+23:25047:x1875174015375872:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305966.858053:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908309a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+23:25047:x1875174015375872:12345-0@lo:501:mount.lustre.0 Request processed in 126us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305966.858062:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788305966.858147:0:25047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015375872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305966.858184:0:25047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015376000:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788305966.858228:0:25047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305966.858256:0:25047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4ded80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305966.858401:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015376000 00000100:00100000:2.0:1788305966.858406:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015376000 00000100:00100000:2.0:1788305966.858440:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788305966.858447:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083099850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+23:25047:x1875174015376000:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788305966.858521:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083099850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+23:25047:x1875174015376000:12345-0@lo:503:mount.lustre.0 Request processed in 75us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305966.858528:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788305966.858730:0:25047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015376000:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788305966.859101:0:25047:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788305966.859176:0:25047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015376128:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788305966.859219:0:25047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305966.859249:0:25047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4ded80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305966.859465:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015376128 00000100:00100000:0.0:1788305966.859470:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015376128 00000100:00100000:0.0:1788305966.859503:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788305966.859510:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908309ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+23:25047:x1875174015376128:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305966.859601:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908309ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+23:25047:x1875174015376128:12345-0@lo:502:mount.lustre.0 Request processed in 91us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305966.859621:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788305966.859706:0:25047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015376128:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788305966.859883:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788305966.859917:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788305966.859931:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788305966.859944:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788305966.859955:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788305966.859966:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788305966.859979:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788305966.859992:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1788305966.860005:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788305966.860017:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1788305966.860031:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1788305966.860055:0:25047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015376256:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788305966.860095:0:25047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305966.861528:0:25047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4ded80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305966.864718:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015376256 00000100:00100000:2.0:1788305966.864734:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015376256 00000100:00100000:2.0:1788305966.864799:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788305966.864811:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908309a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+23:25047:x1875174015376256:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305966.865159:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908309a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+23:25047:x1875174015376256:12345-0@lo:502:mount.lustre.0 Request processed in 349us (5062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305966.865176:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788305966.865411:0:25047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015376256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788305966.865494:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1788305966.865507:0:25047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788305966.875917:0:25055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305966.875932:0:25055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305966.875934:0:25055:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788305966.875942:0:25055:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88908259c800 00000020:00000080:3.0:1788305966.875944:0:25055:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788305966.875952:0:25055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305966.875954:0:25055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305966.875956:0:25055:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788305966.875958:0:25055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305966.875960:0:25055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305966.875961:0:25055:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788305966.875964:0:25055:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88908259c800 00000020:00000080:3.0:1788305966.875966:0:25055:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788305966.876028:0:25055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305966.876031:0:25055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305966.876044:0:25055:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788305966.876047:0:25055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305966.876050:0:25055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305966.876051:0:25055:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788305966.876055:0:25055:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88908259c800 00000020:00000080:3.0:1788305966.876057:0:25055:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788305966.876075:0:25055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305966.876078:0:25055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305966.876079:0:25055:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788305966.876082:0:25055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305966.876084:0:25055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305966.876085:0:25055:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788305966.876089:0:25055:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88908259c800 00000020:00000080:3.0:1788305966.876090:0:25055:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788305966.876109:0:25055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305966.876112:0:25055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305966.876113:0:25055:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788305966.876116:0:25055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788305966.876314:0:25047:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788305966.876351:0:25047:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788305966.876380:0:25047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181683600/0x4a426866e60552e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60552e8 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305966.876393:0:25047:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889181683600/0x4a426866e60552e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60552e8 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305966.876441:0:25047:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788305966.876444:0:25047:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88908259c800 10000000:01000000:2.0:1788305966.876447:0:25047:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88908259c800 10000000:01000000:2.0:1788305966.876451:0:25047:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788305966.876457:0:25047:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88908259c800 from 1 10000000:01000000:2.0:1788305966.876460:0:25047:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788305966.876498:0:25047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e60552ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305966.876506:0:25047:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e60552ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305966.876518:0:25047:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e60552ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305966.876543:0:25047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9914700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015376384:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788305966.876622:0:25047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305966.876670:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015376384 00000100:00100000:2.0:1788305966.876677:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015376384 00000100:00100000:2.0:1788305966.876717:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788305966.876734:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083098c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+23:25047:x1875174015376384:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788305966.876747:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305966.876759:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891bb3ea000/0x4a426866e60552f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60552ef expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305966.876783:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3ea000/0x4a426866e60552f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60552ef expref: 24 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305966.876793:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891bb3ea000/0x4a426866e60552f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60552ef expref: 24 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305966.876803:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ea000, rc 0) 00000100:00100000:2.0:1788305966.876840:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083098c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:25047:x1875174015376384:12345-0@lo:101:mount.lustre.0 Request processed in 108us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305966.876858:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788305966.876901:0:25047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891863e3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788305966.876920:0:25047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9914700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015376384:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788305966.876934:0:25047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e60552ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60552f6 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305966.876943:0:25047:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e60552ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60552f6 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788305966.892403:0:25047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788305966.892977:0:25047:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305966.894853:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788305966.895041:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788305966.895056:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788305966.895067:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788305966.895078:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788305966.895090:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788305966.895101:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788305966.895112:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788305966.895123:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788305966.895200:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788305966.895214:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788305966.895225:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788305966.895236:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788305966.895257:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788305966.895268:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788305966.897046:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788305966.897081:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788305966.897093:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788305966.897105:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788305966.897119:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788305966.898019:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788305966.898049:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788305966.898064:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788305966.898078:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788305966.898090:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1788305966.898101:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1788305966.898113:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1788305966.899307:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1788305966.899367:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1788305966.899384:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1788305966.899397:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1788305966.899410:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1788305966.899424:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1788305966.899439:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1788305966.899452:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1788305966.899465:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1788305966.899476:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1788305966.899488:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1788305966.899499:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1788305966.899511:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1788305966.899543:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1788305966.899558:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1788305966.899569:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1788305966.899580:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1788305966.899593:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1788305966.899843:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1788305966.899879:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1788305966.899892:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1788305966.905934:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1788305966.905998:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1788305966.906025:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1788305966.906030:0:25047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1788305966.906339:0:25047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015376512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305966.906482:0:25047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305966.906529:0:25047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4ded80 going to sleep for 11 seconds 00000100:00100000:3.0:1788305966.909435:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015376512 00000100:00100000:3.0:1788305966.909452:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015376512 00000100:00100000:3.0:1788305966.909524:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788305966.909536:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908309b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:25047:x1875174015376512:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305966.912137:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908309b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:25047:x1875174015376512:12345-0@lo:501:mount.lustre.0 Request processed in 2584us (5636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305966.912151:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788305966.924989:0:25047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015376512:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305966.925072:0:25047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015376640:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788305966.925159:0:25047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305966.925205:0:25047:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083070240 going to sleep for 11 seconds 00000100:00100000:1.0:1788305966.925817:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015376640 00000100:00100000:1.0:1788305966.925826:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015376640 00000100:00100000:1.0:1788305966.925902:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788305966.925913:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:25047:x1875174015376640:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788305966.926074:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:25047:x1875174015376640:12345-0@lo:503:mount.lustre.0 Request processed in 162us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305966.926082:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788305966.926344:0:25047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015376640:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788305966.927035:0:25047:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788305966.927116:0:25047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015376768:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305966.927341:0:25047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305966.927574:0:25047:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083070240 going to sleep for 11 seconds 00000100:00100000:2.0:1788305966.927652:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015376768 00000100:00100000:2.0:1788305966.927659:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015376768 00000100:00100000:2.0:1788305966.927708:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788305966.927717:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:25047:x1875174015376768:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305966.927858:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:25047:x1875174015376768:12345-0@lo:502:mount.lustre.0 Request processed in 141us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305966.927871:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788305966.929929:0:25047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015376768:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788305966.931059:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788305966.931096:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788305966.931114:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788305966.931245:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788305966.931265:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788305966.931297:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788305966.931312:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788305966.931326:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788305966.931341:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788305966.931355:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788305966.931368:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788305966.931382:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788305966.931396:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788305966.931409:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788305966.931424:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788305966.931438:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788305966.931451:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788305966.931463:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788305966.931476:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788305966.931490:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788305966.931504:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788305966.931517:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788305966.931531:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788305966.931544:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788305966.931556:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1788305966.931567:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1788305966.931589:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1788305966.931600:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1788305966.931612:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1788305966.931624:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1788305966.931635:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1788305966.931649:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1788305966.931681:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1788305966.931697:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1788305966.931711:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1788305966.931723:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1788305966.931735:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1788305966.931747:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1788305966.931759:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1788305966.931771:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1788305966.931783:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1788305966.931796:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1788305966.931811:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1788305966.931823:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1788305966.931836:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1788305966.931861:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1788305966.931876:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1788305966.931903:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1788305966.931977:0:25047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015376896:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305966.933587:0:25047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305966.933696:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015376896 00000100:00100000:1.0:1788305966.933706:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015376896 00000100:00100000:0.0:1788305966.933753:0:25047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2b2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788305966.933759:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788305966.933768:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:25047:x1875174015376896:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305966.934933:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:25047:x1875174015376896:12345-0@lo:502:mount.lustre.0 Request processed in 1161us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305966.934944:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788305966.934981:0:25047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015376896:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788305966.936407:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1788305966.936445:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1788305966.936499:0:25047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015377024:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305966.936570:0:25047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305966.936621:0:25047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891814b3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788305966.938214:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015377024 00000100:00100000:0.0:1788305966.938229:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015377024 00000100:00100000:0.0:1788305966.938304:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788305966.938315:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:25047:x1875174015377024:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305966.938485:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:25047:x1875174015377024:12345-0@lo:502:mount.lustre.0 Request processed in 171us (1913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305966.938493:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788305966.939390:0:25047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015377024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788305966.939611:0:25047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1788305966.939625:0:25047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788305966.952163:0:25060:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788305966.952183:0:25060:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff88918678b370) 00000020:00000080:1.0:1788305966.952211:0:25060:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788305966.952348:0:25060:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88908259c800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788305966.952353:0:25060:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88908259c800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788305966.952356:0:25060:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88908259c800 3 00010000:00080000:1.0:1788305966.952399:0:25060:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889083cc7000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.155@tcp at head 00010000:00010000:0.0:1788305966.965291:0:25060:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1788305966.967728:0:25060:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788305966.967777:0:25060:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788305966.970745:0:25060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4a426866e6055304 00000100:00080000:0.0:1788305966.970761:0:25060:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788305966.970769:0:25060:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff889083cc7000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305966.973181:0:25060:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bfaa6680 x1875174015377152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305966.973218:0:25060:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788305966.973468:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788305966.973472:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788305966.973476:0:36:0:(import.c:65:import_set_state_nolock()) ffff88908353f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788305966.973481:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 793 00000100:00080000:3.0:1788305966.973485:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788305966.973491:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88908353f000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305966.973507:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb354a80 x1875174015377536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788305966.973531:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788305966.973534:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788305966.973536:0:36:0:(import.c:65:import_set_state_nolock()) ffff88908273d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788305966.973547:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 793 00000100:00080000:3.0:1788305966.973549:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788305966.973553:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff88908273d800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305966.973565:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb355880 x1875174015378048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788305966.973606:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015377408:0@lo:400:kworker.0 00000100:00100000:3.0:1788305966.973689:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305966.973722:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015378176:0@lo:400:kworker.0 00000100:00100000:3.0:1788305966.973749:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305966.973774:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788305966.973779:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015377664:0@lo:400:kworker.0 00000100:00100000:3.0:1788305966.974029:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305966.974051:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015378304:0@lo:400:kworker.0 00000100:00100000:3.0:1788305966.974078:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305966.974122:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015378176 00000100:00100000:3.0:1788305966.974129:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015378176 00000100:00100000:3.0:1788305966.974168:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015377664 00000100:00100000:3.0:1788305966.974172:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015377664 00000100:00100000:3.0:1788305966.974183:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015378304 00000100:00100000:3.0:1788305966.974185:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015378304 00000100:00100000:3.0:1788305966.974213:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788305966.974221:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015378176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305966.974271:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015378176:12345-0@lo:400:kworker.0 Request processed in 49us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305966.974304:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788305966.974323:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788305966.974338:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015377664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305966.974370:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015377664:12345-0@lo:400:kworker.0 Request processed in 32us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305966.974375:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788305966.974387:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788305966.974393:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015378304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305966.974422:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015378304:12345-0@lo:400:kworker.0 Request processed in 29us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305966.974428:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788305966.974468:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb356680 x1875174015377664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305966.974482:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015377664:0@lo:400:kworker.0 00010000:00080000:3.0:1788305966.974493:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb355c00 x1875174015378304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305966.974501:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015378304:0@lo:400:kworker.0 00010000:00080000:3.0:1788305966.974509:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb354380 x1875174015378176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305966.974516:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015378176:0@lo:400:kworker.0 00000100:00100000:0.0:1788305966.975527:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015377408 00000100:00100000:0.0:1788305966.975535:0:24231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015377408 00000100:00100000:0.0:1788305966.975576:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788305966.975584:0:24231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015377408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305966.975858:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015377280:0@lo:400:kworker.0 00000100:00100000:2.0:1788305966.975936:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875174015377152:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788305966.976520:0:24231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015377408:12345-0@lo:400:kworker.0 Request processed in 936us (2830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305966.976530:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788305966.976558:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788305966.976563:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305966.977470:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305966.977508:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015377920:0@lo:400:kworker.0 00000100:00100000:1.0:1788305966.977539:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305966.977564:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788305966.977570:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015377792:0@lo:400:kworker.0 00000100:00100000:1.0:1788305966.977590:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305966.977611:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015378432:0@lo:400:kworker.0 00000100:00100000:1.0:1788305966.977652:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305966.977706:0:23464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015377280 00000100:00100000:1.0:1788305966.977712:0:23464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015377280 00000100:00100000:1.0:1788305966.977747:0:23464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015377792 00000100:00100000:1.0:1788305966.977750:0:23464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015377792 00000100:00100000:1.0:1788305966.977764:0:23464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788305966.977770:0:23464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015377280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305966.977857:0:23464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015377280:12345-0@lo:400:kworker.0 Request processed in 86us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305966.977864:0:23464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788305966.977882:0:23464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788305966.977888:0:23464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015377792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305966.977917:0:23464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015377792:12345-0@lo:400:kworker.0 Request processed in 30us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305966.977923:0:23464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788305966.977941:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015378432 00000100:00100000:1.0:1788305966.977945:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015378432 00000100:00100000:1.0:1788305966.977980:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788305966.977986:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015378432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305966.978015:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015378432:12345-0@lo:400:kworker.0 Request processed in 30us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305966.978021:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788305966.978057:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015377792:0@lo:400:kworker.0 00010000:00080000:1.0:1788305966.978070:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb356a00 x1875174015378432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305966.978080:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015378432:0@lo:400:kworker.0 00000100:00100000:1.0:1788305966.978089:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015377280:0@lo:400:kworker.0 00000020:01000004:1.0:1788305966.978195:0:25060:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788305966.978209:0:25060:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8891867899b8) 00000020:00000080:1.0:1788305966.978231:0:25060:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788305966.978333:0:25060:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88908259c800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788305966.978338:0:25060:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88908259c800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788305966.978346:0:25060:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88908259c800 3 00010000:00080000:1.0:1788305966.978372:0:25060:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889083cc2800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.155@tcp at head 00010000:00010000:1.0:1788305966.980030:0:25060:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000100:00100000:3.0:1788305966.981746:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015377920 00000100:00100000:3.0:1788305966.981758:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015377920 00000100:00100000:2.0:1788305966.981769:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305966.981806:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788305966.981816:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015377920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305966.982743:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015377536:0@lo:8:kworker.0 00000100:00100000:2.0:1788305966.982786:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305966.982819:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015378048:0@lo:8:kworker.0 00000100:00100000:2.0:1788305966.982852:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1788305966.983173:0:25060:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788305966.983225:0:25060:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788305966.983238:0:25060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x4a426866e6055312 00000100:00080000:1.0:1788305966.983247:0:25060:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788305966.983252:0:25060:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff889083cc2800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305966.983309:0:25060:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb23ea00 x1875174015378560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305966.983332:0:25060:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788305966.983535:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875174015378560:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788305966.983571:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305966.983709:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015377152 00000100:00100000:1.0:1788305966.983715:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015377152 00000100:00100000:1.0:1788305966.983746:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015378560 00000100:00100000:1.0:1788305966.983749:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015378560 00000100:00100000:1.0:1788305966.983767:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788305966.983774:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875174015377152:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788305966.983875:0:23939:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 797 last 0 00000020:00000080:1.0:1788305966.983907:0:23939:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4a426866e6055319 00000004:00100000:1.0:1788305966.983924:0:23939:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788305966.983957:0:23939:0:(import.c:65:import_set_state_nolock()) ffff889083cc0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305966.984011:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875174015377152:12345-0@lo:38:llog_process_th.0 Request processed in 236us (2244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305966.984019:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788305966.984035:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788305966.984039:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875174015378560:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788305966.984054:0:23939:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 797 last 0 00000020:00000080:1.0:1788305966.984096:0:23939:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x4a426866e6055320 00000004:00100000:1.0:1788305966.984106:0:23939:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788305966.984124:0:23939:0:(import.c:65:import_set_state_nolock()) ffff889083cc4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305966.984154:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875174015378560:12345-0@lo:38:llog_process_th.0 Request processed in 113us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305966.984161:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788305966.984210:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb23ea00 x1875174015378560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305966.984221:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788305966.984228:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788305966.984235:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788305966.984239:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788305966.984241:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889083cc2800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788305966.984247:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875174015378560:0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788305966.984263:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bfaa6680 x1875174015377152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305966.984271:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788305966.984301:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788305966.984306:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788305966.984308:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788305966.984310:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889083cc7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788305966.984314:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875174015377152:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788305966.984409:0:25060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:0.0:1788305966.984920:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015377408:0@lo:400:kworker.0 00000100:00080000:0.0:1788305966.984948:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788305966.984972:0:24697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015377536 00000100:00100000:0.0:1788305966.984978:0:24697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015377536 00000100:00100000:0.0:1788305966.984996:0:24697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015378048 00000100:00100000:0.0:1788305966.984999:0:24697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015378048 00000100:00100000:0.0:1788305966.985010:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788305966.985015:0:24697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875174015377536:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788305966.985085:0:24697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875174015377536:12345-0@lo:8:kworker.0 Request processed in 68us (2298us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788305966.985091:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788305966.985104:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788305966.985107:0:24697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875174015378048:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788305966.985139:0:24697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875174015378048:12345-0@lo:8:kworker.0 Request processed in 30us (2295us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788305966.985144:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788305966.985397:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788305966.985404:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908353f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305966.985414:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788305966.985417:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015377536:0@lo:8:kworker.0 00000100:00100000:1.0:1788305966.985430:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788305966.985434:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908273d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305966.985437:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788305966.985440:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015378048:0@lo:8:kworker.0 00000100:00100000:3.0:1788305966.985710:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015377920:12345-0@lo:400:kworker.0 Request processed in 3894us (8168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305966.985727:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:3.0:1788305966.985755:0:25047:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788305966.985797:0:25047:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788305966.985813:0:25047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e60552ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60552f6 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305966.985826:0:25047:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e60552ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60552f6 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788305966.985883:0:25047:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788305966.985897:0:25047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788305966.985898:0:25047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788305966.985899:0:25047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788305966.985901:0:25047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788305966.985902:0:25047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788305966.985904:0:25047:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788305966.985906:0:25047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788305966.985907:0:25047:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788305966.985911:0:25047:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788305966.985913:0:25047:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788305966.985915:0:25047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788305966.985916:0:25047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788305966.985917:0:25047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788305966.985918:0:25047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788305966.985919:0:25047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788305966.985920:0:25047:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788305966.985921:0:25047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788305966.985922:0:25047:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788305966.985945:0:25047:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788305966.985961:0:25047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015378688:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788305966.986001:0:25047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305966.986372:0:25047:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4ded80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305966.986408:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015378688 00000100:00100000:0.0:1788305966.986414:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015378688 00000100:00100000:0.0:1788305966.986453:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788305966.986462:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:25047:x1875174015378688:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788305966.986488:0:22714:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788305966.986502:0:22714:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788305966.987968:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015377920:0@lo:400:kworker.0 20000000:01000000:1.0:1788305966.992883:0:22714:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788305966.992905:0:22714:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788305966.993222:0:22737:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788305966.993228:0:22737:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788305966.993250:0:22737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6055327 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305966.993267:0:22737:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88919d7df200/0x4a426866e60551b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60551ad expref: 24 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305966.993308:0:22737:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891bb3eba00/0x4a426866e60551c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60551bb expref: 24 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305966.993315:0:22737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6055327 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305966.993357:0:22737:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891bb3eba00/0x4a426866e60551c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60551bb expref: 24 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305966.993370:0:22737:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8891bb3eba00/0x4a426866e60551c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60551bb expref: 24 pid: 22714 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305966.993399:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b9917100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22737:1875174015378816:0@lo:104: 00000100:00100000:2.0:1788305966.993464:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788305966.993519:0:22737:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88919d7df200/0x4a426866e60551b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60551ad expref: 24 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305966.993528:0:22737:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88919d7df200/0x4a426866e60551b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60551ad expref: 24 pid: 22716 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305966.993536:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22737:1875174015378944:0@lo:104: 00000100:00100000:2.0:1788305966.993558:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305966.993572:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891852e4600 going to sleep for 11 seconds 00000100:00100000:0.0:1788305966.993676:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015378816 00000100:00100000:0.0:1788305966.993683:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015378816 00000100:00100000:0.0:1788305966.993749:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015378944 00000100:00100000:0.0:1788305966.993752:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015378944 00000100:00100000:0.0:1788305966.993767:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305966.993776:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9916300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+4:22737:x1875174015378816:12345-0@lo:104: 00010000:00010000:0.0:1788305966.993800:0:22706:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60551bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60551c2 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.993887:0:22706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788305966.993894:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9916300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+4:22737:x1875174015378816:12345-0@lo:104: Request processed in 119us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305966.993902:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305966.993918:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305966.993924:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188560000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+3:22737:x1875174015378944:12345-0@lo:104: 00010000:00010000:0.0:1788305966.993931:0:22706:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e60551ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60551b4 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.993964:0:22706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788305966.993969:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188560000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+3:22737:x1875174015378944:12345-0@lo:104: Request processed in 47us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305966.993976:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788305966.994000:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788305966.994005:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60551bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60551c2 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.994013:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523b200 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:0.0:1788305966.994017:0:24891:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60551bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60551c2 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.994024:0:24891:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60551bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60551c2 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305966.994031:0:24891:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60551bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60551c2 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305966.994037:0:24891:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788305966.994072:0:24891:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60551bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60551c2 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.994079:0:24891:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305966.994102:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60551bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60551c2 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.994109:0:24891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e60551bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60551c2 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.994119:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305966.994123:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e60551ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60551b4 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.994128:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523a000 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:0.0:1788305966.994131:0:24891:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e60551ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60551b4 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.994138:0:24891:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e60551ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60551b4 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305966.994143:0:24891:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e60551ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60551b4 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305966.994149:0:24891:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788305966.994161:0:24891:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e60551ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60551b4 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.994167:0:24891:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305966.994182:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e60551ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60551b4 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.994198:0:24891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e60551ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60551b4 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.994211:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305966.994212:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305966.994214:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305966.994230:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305966.994242:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4402ecd-e8a2-4271-82d7-771a7bb97982:3649:1875174015379072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305966.994294:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305966.994322:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4402ecd-e8a2-4271-82d7-771a7bb97982:3647:1875174015379200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305966.994345:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305966.994376:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015379072 00000100:00100000:0.0:1788305966.994380:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015379072 00010000:00010000:0.0:1788305966.994397:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891bb3eba00/0x4a426866e60551c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60551bb expref: 25 pid: 22714 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305966.994417:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015379200 00000100:00100000:0.0:1788305966.994420:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015379200 00010000:00010000:0.0:1788305966.994430:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88919d7df200/0x4a426866e60551b4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60551ad expref: 26 pid: 22716 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305966.994442:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305966.994448:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4402ecd-e8a2-4271-82d7-771a7bb97982+26:3649:x1875174015379072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305966.994458:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305966.994463:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891bb3eba00/0x4a426866e60551c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60551bb expref: 26 pid: 22714 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.994473:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891bb3eba00/0x4a426866e60551c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60551bb expref: 26 pid: 22714 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.994495:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305966.994525:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4402ecd-e8a2-4271-82d7-771a7bb97982+26:3649:x1875174015379072:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305966.994532:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305966.994544:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305966.994549:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4402ecd-e8a2-4271-82d7-771a7bb97982+25:3647:x1875174015379200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305966.994556:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305966.994560:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88919d7df200/0x4a426866e60551b4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60551ad expref: 25 pid: 22716 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.994568:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88919d7df200/0x4a426866e60551b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60551ad expref: 25 pid: 22716 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.994579:0:22709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6055327 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.994586:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6055327 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788305966.994599:0:22709:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009268575s 00010000:00010000:0.0:1788305966.994604:0:22709:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6055327 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.994610:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6055327 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.994616:0:22709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6055327 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.994632:0:22709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6055327 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.994637:0:22709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebe00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305966.994642:0:22709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6055327 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.994649:0:22709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6055327 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.994657:0:22709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6055327 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305966.994666:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305966.994696:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4402ecd-e8a2-4271-82d7-771a7bb97982+25:3647:x1875174015379200:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305966.994703:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305966.994742:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4402ecd-e8a2-4271-82d7-771a7bb97982:3647:1875174015379200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305966.994767:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4402ecd-e8a2-4271-82d7-771a7bb97982:3649:1875174015379072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305966.994995:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:25047:x1875174015378688:12345-0@lo:253:mount.lustre.0 Request processed in 8534us (8992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305966.995004:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00010000:2.0:1788305966.995167:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3eba00/0x4a426866e60551c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60551bb expref: 23 pid: 22714 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305966.995177:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b9917100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22737:1875174015378816:0@lo:104: 00010000:00010000:2.0:1788305966.995187:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88919d7df200/0x4a426866e60551b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60551ad expref: 22 pid: 22716 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305966.995193:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22737:1875174015378944:0@lo:104: 00010000:00010000:2.0:1788305966.995211:0:22737:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6055327 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305966.995220:0:22737:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6055327 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305966.995226:0:22737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6055327 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305966.995243:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6055327 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305966.995328:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305966.995899:0:25047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4402ecd-e8a2-4271-82d7-771a7bb97982:25047:1875174015378688:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788305966.995912:0:25047:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788305966.995915:0:25047:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788305966.995916:0:25047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788305966.995918:0:25047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305966.995919:0:25047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305966.995920:0:25047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305966.995921:0:25047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305966.995923:0:25047:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788305966.995932:0:25047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305966.995933:0:25047:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788305966.995945:0:25047:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1788305966.998011:0:25047:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1788305967.004769:0:25047:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788305967.004780:0:25047:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788305967.004894:0:25047:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788305967.004941:0:25047:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.155@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788305967.004959:0:25047:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788305967.004996:0:25047:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788305967.005985:0:25047:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788305967.006222:0:25047:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788305967.831074:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788305967.846259:0:25114:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788305967.846486:0:25114:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788305968.668876:0:22720:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788305968.668886:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8891bfab2000 from 14 10000000:01000000:1.0:1788305968.668893:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788305968.668950:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff88919d7dfc00/0x4a426866e605532e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305968.669062:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff88919d7dfc00/0x4a426866e605532e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305968.669093:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff88919d7dfc00/0x4a426866e605532e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305968.669122:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015379328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788305968.669296:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305968.670051:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af270840 going to sleep for 11 seconds 00000100:00100000:2.0:1788305968.670150:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015379328 00000100:00100000:2.0:1788305968.670159:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015379328 00000100:00100000:2.0:1788305968.670626:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788305968.670637:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+22:22720:x1875174015379328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305968.670650:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305968.670679:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891bb3eb000/0x4a426866e6055335 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605532e expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305968.670704:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3eb000/0x4a426866e6055335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605532e expref: 23 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305968.670716:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891bb3eb000/0x4a426866e6055335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605532e expref: 23 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305968.670725:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb000, rc 0) 00000100:00100000:2.0:1788305968.670915:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+23:22720:x1875174015379328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305968.670922:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788305968.671085:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015379328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305968.671103:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff88919d7dfc00/0x4a426866e605532e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055335 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305968.671113:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff88919d7dfc00/0x4a426866e605532e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6055335 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305968.671191:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015379456:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788305968.671228:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305968.671262:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af270840 going to sleep for 11 seconds 00000100:00100000:2.0:1788305968.671499:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015379456 00000100:00100000:2.0:1788305968.671504:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015379456 00000100:00100000:2.0:1788305968.671538:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788305968.671546:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+23:22720:x1875174015379456:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788305968.671561:0:22714:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788305968.671584:0:22714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788305968.671600:0:22714:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788305968.671870:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+23:22720:x1875174015379456:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 323us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305968.671878:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788305968.672542:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015379456:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788305968.672625:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788305968.672634:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff88919d7dfc00/0x4a426866e605532e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055335 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305968.672643:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff88919d7dfc00/0x4a426866e605532e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055335 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305968.672653:0:22720:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788305968.672656:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8891bbb3a800 from 14 10000000:01000000:1.0:1788305968.672859:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788305968.672888:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff88919d7dfa00/0x4a426866e605533c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305968.672896:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff88919d7dfa00/0x4a426866e605533c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305968.672905:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff88919d7dfa00/0x4a426866e605533c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305968.672922:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015379584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788305968.672967:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305968.673095:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af270840 going to sleep for 11 seconds 00000100:00100000:0.0:1788305968.674033:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015379584 00000100:00100000:0.0:1788305968.674041:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015379584 00000100:00100000:0.0:1788305968.674119:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788305968.674127:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+23:22720:x1875174015379584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305968.674139:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305968.674154:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891903f8000/0x4a426866e6055343 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605533c expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305968.674187:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891903f8000/0x4a426866e6055343 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605533c expref: 24 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305968.674197:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891903f8000/0x4a426866e6055343 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605533c expref: 24 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305968.674205:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8000, rc 0) 00000100:00100000:0.0:1788305968.674265:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:22720:x1875174015379584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305968.674271:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788305968.674404:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015379584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305968.674421:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff88919d7dfa00/0x4a426866e605533c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055343 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305968.674430:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff88919d7dfa00/0x4a426866e605533c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6055343 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305968.674491:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015379712:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788305968.674528:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305968.675115:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af270840 going to sleep for 11 seconds 00000100:00100000:2.0:1788305968.675225:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015379712 00000100:00100000:2.0:1788305968.675231:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015379712 00000100:00100000:2.0:1788305968.675259:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788305968.675267:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:22720:x1875174015379712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788305968.675316:0:22714:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788305968.675335:0:22714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788305968.675338:0:22714:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788305968.675630:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:22720:x1875174015379712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 362us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305968.675639:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788305968.675901:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015379712:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788305968.675968:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788305968.675977:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff88919d7dfa00/0x4a426866e605533c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055343 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305968.675995:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff88919d7dfa00/0x4a426866e605533c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055343 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305968.856185:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305969.110440:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015379968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305969.110514:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305969.110515:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015379840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305969.110568:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305969.110588:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015379968 00000100:00100000:0.0:1788305969.110597:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015379968 00000100:00100000:3.0:1788305969.110612:0:23464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015379840 00000100:00100000:3.0:1788305969.110629:0:23464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015379840 00000100:00100000:0.0:1788305969.110659:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788305969.110668:0:23464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788305969.110671:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015379968:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305969.110680:0:23464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015379840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788305969.110719:0:23464:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00002000:00000024:0.0:1788305969.110719:0:24234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788305969.110773:0:23464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015379840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305969.110781:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015379968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305969.110784:0:23464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788305969.110794:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788305969.110818:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305969.110865:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015379968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305969.110928:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015379840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305969.621852:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305969.621877:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015380096:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305969.621950:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305969.622053:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015380096 00000100:00100000:3.0:1788305969.622062:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015380096 00000100:00100000:3.0:1788305969.622115:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788305969.622126:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015380096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788305969.622161:0:22726:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788305969.622214:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015380096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305969.622222:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788305969.622265:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015380096:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788305969.879028:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305970.137763:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788305970.137786:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015380224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305970.137866:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305970.137913:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015380224 00000100:00100000:3.0:1788305970.137921:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015380224 00000100:00100000:3.0:1788305970.137976:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788305970.137994:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015380224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788305970.138015:0:24234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788305970.138059:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015380224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305970.138067:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788305970.138098:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305970.138133:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015380224:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1788305970.267765:0:22756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788305970.913254:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305971.927817:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788305972.182395:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305972.182401:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788305972.182404:0:36:0:(import.c:65:import_set_state_nolock()) ffff88908353f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305972.182413:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88908353f000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305972.182429:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb23c700 x1875174015380736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305972.182454:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305972.182456:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788305972.182458:0:36:0:(import.c:65:import_set_state_nolock()) ffff88908273d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305972.182460:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff88908273d800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305972.182466:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88918caab100 x1875174015381248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788305972.182510:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4402ecd-e8a2-4271-82d7-771a7bb97982:3648:1875174015380352:0@lo:400:kworker.0 00000100:00100000:1.0:1788305972.182581:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305972.182633:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015380992:0@lo:400:kworker.0 00000100:00100000:1.0:1788305972.182661:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305972.182681:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015381632:0@lo:400:kworker.0 00000100:00100000:1.0:1788305972.182705:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305972.182729:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788305972.182735:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015380864:0@lo:400:kworker.0 00000100:00100000:1.0:1788305972.182771:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305972.182788:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015381504:0@lo:400:kworker.0 00000100:00100000:1.0:1788305972.182820:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305972.182848:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015380480:0@lo:400:kworker.0 00000100:00100000:1.0:1788305972.182870:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305972.182885:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015381120:0@lo:400:kworker.0 00000100:00100000:1.0:1788305972.182903:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305972.182923:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875174015381760:0@lo:400:kworker.0 00000100:00100000:1.0:1788305972.182942:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305972.182958:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788305972.182963:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015380608:0@lo:400:kworker.0 00000100:00100000:1.0:1788305972.182983:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305972.182997:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015381376:0@lo:400:kworker.0 00000100:00100000:1.0:1788305972.183014:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305972.183024:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015381888:0@lo:400:kworker.0 00000100:00100000:1.0:1788305972.183041:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305972.183063:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb23c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015380736:0@lo:8:kworker.0 00000100:00100000:1.0:1788305972.183085:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305972.183225:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015381632 00000100:00100000:2.0:1788305972.183233:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015381632 00000100:00100000:2.0:1788305972.183297:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015380864 00000100:00100000:2.0:1788305972.183301:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015380864 00000100:00100000:2.0:1788305972.183315:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015381504 00000100:00100000:2.0:1788305972.183318:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015381504 00000100:00100000:2.0:1788305972.183330:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015381760 00000100:00100000:2.0:1788305972.183333:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015381760 00000100:00100000:2.0:1788305972.183343:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015381376 00000100:00100000:2.0:1788305972.183345:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015381376 00000100:00100000:2.0:1788305972.183355:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015381888 00000100:00100000:2.0:1788305972.183357:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015381888 00000100:00100000:2.0:1788305972.183384:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788305972.183392:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015381632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305972.183449:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015381632:12345-0@lo:400:kworker.0 Request processed in 58us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305972.183456:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788305972.183473:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788305972.183480:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015380864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305972.183507:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015380864:12345-0@lo:400:kworker.0 Request processed in 28us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305972.183512:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788305972.183524:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788305972.183530:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015381504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305972.183556:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015381504:12345-0@lo:400:kworker.0 Request processed in 26us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305972.183561:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788305972.183573:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788305972.183580:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875174015381760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305972.188964:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875174015381760:12345-0@lo:400:kworker.0 Request processed in 5374us (6010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305972.188981:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788305972.189021:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788305972.189033:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015381376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305972.189084:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015381376:12345-0@lo:400:kworker.0 Request processed in 56us (6068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305972.189090:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788305972.189121:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788305972.189128:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015381888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305972.189161:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015381888:12345-0@lo:400:kworker.0 Request processed in 34us (6119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305972.189167:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788305972.189193:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788305972.189198:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788305972.192546:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015380992 00000100:00100000:2.0:1788305972.192561:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015380992 00000100:00100000:2.0:1788305972.192625:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015380480 00000100:00100000:2.0:1788305972.192629:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015380480 00000100:00100000:2.0:1788305972.192650:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788305972.192659:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015380992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305972.192756:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015380992:12345-0@lo:400:kworker.0 Request processed in 97us (10092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305972.192763:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788305972.192782:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788305972.192787:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015380480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305972.192828:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015380480:12345-0@lo:400:kworker.0 Request processed in 41us (9957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305972.192834:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788305972.192873:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015380352 00000100:00100000:2.0:1788305972.192879:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015380352 00000100:00100000:2.0:1788305972.192917:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788305972.192923:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:3648:x1875174015380352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305972.192954:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:3648:x1875174015380352:12345-0@lo:400:kworker.0 Request processed in 31us (10374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305972.192981:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:1.0:1788305972.194851:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88918caabb80 x1875174015381376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305972.194870:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015381376:0@lo:400:kworker.0 00010000:00080000:1.0:1788305972.194884:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88918caaaa00 x1875174015381888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305972.194892:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015381888:0@lo:400:kworker.0 00000100:00100000:1.0:1788305972.194923:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015380480:0@lo:400:kworker.0 00010000:00080000:1.0:1788305972.194936:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88918caa8a80 x1875174015381760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305972.194944:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875174015381760:0@lo:400:kworker.0 00000100:00100000:1.0:1788305972.194987:0:24697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015381120 00000100:00100000:1.0:1788305972.194993:0:24697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015381120 00000100:00100000:1.0:1788305972.195060:0:24697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015380608 00000100:00100000:1.0:1788305972.195064:0:24697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015380608 00000100:00100000:1.0:1788305972.195080:0:24697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015380736 00000100:00100000:1.0:1788305972.195082:0:24697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015380736 00000100:00100000:1.0:1788305972.195096:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788305972.195105:0:24697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015381120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305972.195186:0:24697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015381120:12345-0@lo:400:kworker.0 Request processed in 81us (12280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305972.195193:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788305972.195212:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788305972.195219:0:24697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015380608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305972.195248:0:24697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015380608:12345-0@lo:400:kworker.0 Request processed in 31us (12265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305972.195254:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788305972.195266:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305972.195272:0:24697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875174015380736:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788305972.195335:0:24697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 802 last 0 00000020:00000080:1.0:1788305972.195365:0:24697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4a426866e605534a 00002000:00100000:1.0:1788305972.195378:0:24697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff889083cc2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788305972.195391:0:24697:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788305972.195394:0:24697:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788305972.195586:0:24697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788305972.195613:0:24697:0:(import.c:65:import_set_state_nolock()) ffff889083cc5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305972.195651:0:24697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1875174015380736:12345-0@lo:8:kworker.0 Request processed in 380us (12565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305972.195658:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305972.195697:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015380608:0@lo:400:kworker.0 00000100:00100000:1.0:1788305972.195707:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015381120:0@lo:400:kworker.0 00010000:00080000:1.0:1788305972.195740:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb23f100 x1875174015380864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305972.195750:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015380864:0@lo:400:kworker.0 00010000:00080000:1.0:1788305972.195762:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88918caa8380 x1875174015381504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305972.195769:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015381504:0@lo:400:kworker.0 00000100:00100000:1.0:1788305972.195779:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4402ecd-e8a2-4271-82d7-771a7bb97982:3648:1875174015380352:0@lo:400:kworker.0 00000100:00100000:1.0:1788305972.195789:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015380992:0@lo:400:kworker.0 00010000:00080000:1.0:1788305972.195814:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88918caa8e00 x1875174015381632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305972.195821:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015381632:0@lo:400:kworker.0 00010000:00080000:1.0:1788305972.195856:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb23c700 x1875174015380736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788305997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788305972.195880:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788305972.195888:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788305972.195893:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788305972.195895:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908353f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788305972.195911:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788305972.195917:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb23c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015380736:0@lo:8:kworker.0 00000100:00100000:1.0:1788305972.195926:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015381248:0@lo:8:kworker.0 00000100:00100000:1.0:1788305972.195960:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305972.195982:0:24697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015381248 00000100:00100000:1.0:1788305972.195986:0:24697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015381248 00000100:00100000:1.0:1788305972.196006:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788305972.196011:0:24697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875174015381248:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788305972.196027:0:24697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 802 last 0 00000020:00000080:1.0:1788305972.196043:0:24697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4a426866e6055351 00002000:00100000:1.0:1788305972.196049:0:24697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff889083cc3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788305972.196052:0:24697:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788305972.196054:0:24697:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788305972.196078:0:24697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788305972.196090:0:24697:0:(import.c:65:import_set_state_nolock()) ffff889083cc0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305972.196117:0:24697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3646:x1875174015381248:12345-0@lo:8:kworker.0 Request processed in 105us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305972.196123:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788305972.196148:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88918caab100 x1875174015381248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788305997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788305972.196157:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788305972.196170:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788305972.196173:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788305972.196175:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908273d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788305972.196187:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788305972.196191:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015381248:0@lo:8:kworker.0 00000004:00080000:1.0:1788305972.196238:0:23468:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788305972.196255:0:23468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23468:1875174015382144:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788305972.196303:0:23468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305972.196320:0:23468:0:(client.c:2715:ptlrpc_set_wait()) set ffff88919e0bff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305972.196334:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015382016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788305972.196360:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305972.196385:0:24697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015382144 00000100:00100000:1.0:1788305972.196389:0:24697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015382144 00000100:00100000:1.0:1788305972.196414:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788305972.196419:0:24697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23468:x1875174015382144:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788305972.196755:0:22748:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1788305972.196772:0:22748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e67480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22748:1875174015382400:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788305972.196814:0:22748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305972.196828:0:22748:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891903cae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788305972.196842:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015382016 00000100:00100000:3.0:1788305972.196845:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015382016 00000100:00100000:3.0:1788305972.196873:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788305972.196880:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3647:x1875174015382016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788305972.196897:0:24234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788305972.196930:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3647:x1875174015382016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305972.196937:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788305972.196964:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88918caab100 x1875174015382016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305972.196978:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015382016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305972.196989:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788305972.196994:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015382272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305972.197027:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305972.197056:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015382272 00000100:00100000:3.0:1788305972.197060:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015382272 00000100:00100000:3.0:1788305972.197079:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788305972.197085:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875174015382272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305972.197095:0:24235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788305972.197125:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875174015382272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305972.197131:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788305972.197153:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083e65c00 x1875174015382272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305972.197165:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015382272:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1788305972.197531:0:23467:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788305972.197619:0:23467:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 802288342544ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788305972.197626:0:23467:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:2.0:1788305972.197653:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788305972.197657:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305972.198404:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015382400 00000100:00100000:2.0:1788305972.198412:0:24232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015382400 00000100:00100000:2.0:1788305972.198450:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788305972.198459:0:24232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22748:x1875174015382400:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788305972.199716:0:23456:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:2.0:1788305972.202379:0:22747:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788305972.202490:0:22747:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 802293213786ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788305972.202499:0:22747:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788305972.204298:0:22702:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1788305972.211238:0:24697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788305972.211248:0:24697:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788305972.211374:0:24697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23468:x1875174015382144:12345-0@lo:7:osp-pre-1-1.0 Request processed in 14949us (15065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305972.211387:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788305972.211501:0:23468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88918caa8380 x1875174015382144/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788305988 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305972.211517:0:23468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23468:1875174015382144:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788305972.211531:0:23468:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788305972.211583:0:23468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23468:1875174015382528:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788305972.211620:0:23468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305972.211650:0:23468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2fb240 going to sleep for 11 seconds 00000100:00100000:3.0:1788305972.212051:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015382528 00000100:00100000:3.0:1788305972.212058:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015382528 00000100:00100000:3.0:1788305972.212118:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788305972.212128:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23468:x1875174015382528:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788305972.212157:0:24233:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1788305972.212204:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23468:x1875174015382528:12345-0@lo:5:osp-pre-1-1.0 Request processed in 77us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305972.212210:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788305972.212640:0:23468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88918caa8380 x1875174015382528/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788305988 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305972.212653:0:23468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23468:1875174015382528:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788305972.212664:0:23468:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788305972.212694:0:23468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23468:1875174015382656:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1788305972.212727:0:23468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305972.212757:0:23468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfae8600 going to sleep for 11 seconds 00000100:00100000:1.0:1788305972.212818:0:24697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015382656 00000100:00100000:1.0:1788305972.212823:0:24697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015382656 00000100:00100000:1.0:1788305972.212870:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788305972.212878:0:24697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23468:x1875174015382656:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788305972.212908:0:24697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00080000:3.0:1788305972.214685:0:24232:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788305972.214695:0:24232:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1788305972.214708:0:24232:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00010000:3.0:1788305972.228031:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305972.228042:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d51ee9a/0x4a426866e6055358 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.228060:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=802s v=(0 0) 00010000:00010000:3.0:1788305972.228065:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305972.228071:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d51ee9a/0x4a426866e6055358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.228089:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d51ee9a/0x4a426866e6055358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.228099:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d51ee9a/0x4a426866e6055358 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.228107:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d51ee9a/0x4a426866e6055358 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.228134:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788305972.228486:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305972.228491:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052b2f73a/0x4a426866e605535f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.228501:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=802s v=(0 0) 00010000:00010000:3.0:1788305972.228504:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305972.228508:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052b2f73a/0x4a426866e605535f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.228524:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052b2f73a/0x4a426866e605535f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.228532:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052b2f73a/0x4a426866e605535f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.228538:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052b2f73a/0x4a426866e605535f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.228554:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788305972.228651:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305972.228658:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d51ee9a/0x4a426866e6055358 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.228667:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181682a00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305972.228679:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d51ee9a/0x4a426866e6055358 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.228688:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d51ee9a/0x4a426866e6055358 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.228707:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d51ee9a/0x4a426866e6055358 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.228715:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d51ee9a/0x4a426866e6055358 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.228734:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305972.228737:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052b2f73a/0x4a426866e605535f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.228744:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181683000 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305972.228747:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052b2f73a/0x4a426866e605535f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.228754:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052b2f73a/0x4a426866e605535f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.228763:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052b2f73a/0x4a426866e605535f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.228770:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052b2f73a/0x4a426866e605535f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.228790:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.228792:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.228794:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788305972.229098:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305972.229104:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf570dfe/0x4a426866e6055366 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.229113:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=802s v=(0 0) 00010000:00010000:3.0:1788305972.229116:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305972.229121:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf570dfe/0x4a426866e6055366 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.229129:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf570dfe/0x4a426866e6055366 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.229137:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf570dfe/0x4a426866e6055366 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.229155:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf570dfe/0x4a426866e6055366 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.233334:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788305972.234123:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305972.234134:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056cc194c/0x4a426866e605536d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.234152:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=802s v=(0 0) 00010000:00010000:3.0:1788305972.234157:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305972.234164:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056cc194c/0x4a426866e605536d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.234179:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056cc194c/0x4a426866e605536d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.234190:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056cc194c/0x4a426866e605536d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.234197:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056cc194c/0x4a426866e605536d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.234270:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305972.234290:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf570dfe/0x4a426866e6055366 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.234298:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181682600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305972.234303:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf570dfe/0x4a426866e6055366 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.234311:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf570dfe/0x4a426866e6055366 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.234329:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf570dfe/0x4a426866e6055366 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.234336:0:24891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf570dfe/0x4a426866e6055366 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.234357:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305972.234361:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056cc194c/0x4a426866e605536d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.234366:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181683a00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305972.234377:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056cc194c/0x4a426866e605536d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.234385:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056cc194c/0x4a426866e605536d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.234395:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056cc194c/0x4a426866e605536d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.234404:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.234406:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.234408:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305972.234964:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305972.237315:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788305972.237328:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056cc194c/0x4a426866e605536d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.237822:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788305972.238078:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305972.238086:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087226f0d/0x4a426866e6055374 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.238402:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=802s v=(0 0) 00010000:00010000:3.0:1788305972.238409:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305972.238416:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087226f0d/0x4a426866e6055374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.238432:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087226f0d/0x4a426866e6055374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.238442:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087226f0d/0x4a426866e6055374 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.238450:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087226f0d/0x4a426866e6055374 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.238464:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305972.239195:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305972.239204:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087226f0d/0x4a426866e6055374 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.239214:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181683800 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305972.239219:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087226f0d/0x4a426866e6055374 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.239228:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087226f0d/0x4a426866e6055374 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.239249:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087226f0d/0x4a426866e6055374 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.239257:0:24891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087226f0d/0x4a426866e6055374 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.239299:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305972.239301:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305972.239303:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788305972.240430:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305972.240439:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a31d243/0x4a426866e605537b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.240453:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=802s v=(0 0) 00010000:00010000:3.0:1788305972.240457:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305972.240471:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a31d243/0x4a426866e605537b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.240484:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a31d243/0x4a426866e605537b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.240494:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a31d243/0x4a426866e605537b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.240501:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a31d243/0x4a426866e605537b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.240527:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305972.241302:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305972.241311:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a31d243/0x4a426866e605537b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.241320:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181682e00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305972.241324:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a31d243/0x4a426866e605537b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.241333:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a31d243/0x4a426866e605537b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.241352:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a31d243/0x4a426866e605537b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.241359:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a31d243/0x4a426866e605537b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.241381:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305972.241390:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305972.241392:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788305972.242505:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305972.242515:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ec48312/0x4a426866e6055382 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.242530:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=802s v=(0 0) 00010000:00010000:3.0:1788305972.242534:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305972.242540:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ec48312/0x4a426866e6055382 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.242550:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ec48312/0x4a426866e6055382 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.242566:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ec48312/0x4a426866e6055382 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.242584:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ec48312/0x4a426866e6055382 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.242604:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788305972.243209:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305972.243219:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ec48312/0x4a426866e6055382 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.243227:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181683200 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305972.243232:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ec48312/0x4a426866e6055382 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.243241:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ec48312/0x4a426866e6055382 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.243261:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ec48312/0x4a426866e6055382 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.243268:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ec48312/0x4a426866e6055382 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.243327:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.243329:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.243331:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788305972.244650:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305972.244663:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f67ba84f/0x4a426866e6055389 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.244677:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=802s v=(0 0) 00010000:00010000:2.0:1788305972.244682:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305972.244689:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f67ba84f/0x4a426866e6055389 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.244703:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f67ba84f/0x4a426866e6055389 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.244711:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f67ba84f/0x4a426866e6055389 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.244718:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f67ba84f/0x4a426866e6055389 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.244742:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305972.246117:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305972.246130:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f67ba84f/0x4a426866e6055389 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.246154:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eba00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305972.246159:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f67ba84f/0x4a426866e6055389 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.246168:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f67ba84f/0x4a426866e6055389 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.246187:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f67ba84f/0x4a426866e6055389 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.246194:0:24891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f67ba84f/0x4a426866e6055389 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.246218:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305972.246220:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305972.246222:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788305972.246380:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305972.246388:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1b28352/0x4a426866e6055390 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.246409:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=802s v=(0 0) 00010000:00010000:2.0:1788305972.246413:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305972.246419:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1b28352/0x4a426866e6055390 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.246430:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1b28352/0x4a426866e6055390 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.246438:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1b28352/0x4a426866e6055390 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.246445:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1b28352/0x4a426866e6055390 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.246471:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305972.247022:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305972.247029:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1b28352/0x4a426866e6055390 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.247038:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebe00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305972.247042:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1b28352/0x4a426866e6055390 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.247049:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1b28352/0x4a426866e6055390 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.247070:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1b28352/0x4a426866e6055390 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.247078:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1b28352/0x4a426866e6055390 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.247094:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305972.247096:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305972.247098:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788305972.256470:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305972.256482:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056cc194c/0x4a426866e6055397 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.256501:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=802s v=(0 0) 00010000:00010000:3.0:1788305972.256507:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305972.256514:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056cc194c/0x4a426866e6055397 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.256529:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056cc194c/0x4a426866e6055397 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.256541:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056cc194c/0x4a426866e6055397 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.256548:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056cc194c/0x4a426866e6055397 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.256585:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788305972.256713:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305972.256721:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056cc194c/0x4a426866e6055397 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.256730:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181683a00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305972.256735:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056cc194c/0x4a426866e6055397 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.256744:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056cc194c/0x4a426866e6055397 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.256774:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056cc194c/0x4a426866e6055397 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.256781:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056cc194c/0x4a426866e6055397 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.256814:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.256817:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.256819:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788305972.258517:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305972.258529:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ec48312/0x4a426866e605539e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.258555:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=802s v=(0 0) 00010000:00010000:3.0:1788305972.258635:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305972.258641:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ec48312/0x4a426866e605539e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.258655:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ec48312/0x4a426866e605539e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.258664:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ec48312/0x4a426866e605539e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.258672:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ec48312/0x4a426866e605539e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.258696:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788305972.259040:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305972.259047:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a31d243/0x4a426866e60553a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.259056:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=802s v=(0 0) 00010000:00010000:3.0:1788305972.259059:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305972.259063:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a31d243/0x4a426866e60553a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.259071:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a31d243/0x4a426866e60553a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.259089:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a31d243/0x4a426866e60553a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.259096:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a31d243/0x4a426866e60553a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.259120:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788305972.259374:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305972.259382:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ec48312/0x4a426866e605539e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.259391:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181683200 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305972.259395:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ec48312/0x4a426866e605539e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.259404:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ec48312/0x4a426866e605539e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.259421:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ec48312/0x4a426866e605539e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.259429:0:24891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ec48312/0x4a426866e605539e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.259458:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305972.259462:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a31d243/0x4a426866e60553a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.259469:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181682e00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305972.259473:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a31d243/0x4a426866e60553a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.259480:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a31d243/0x4a426866e60553a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.259491:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a31d243/0x4a426866e60553a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.259498:0:24891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a31d243/0x4a426866e60553a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.259509:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.259511:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.259512:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788305972.259666:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305972.259673:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf570dfe/0x4a426866e60553ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.259681:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=802s v=(0 0) 00010000:00010000:3.0:1788305972.259685:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305972.259690:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf570dfe/0x4a426866e60553ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.259699:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf570dfe/0x4a426866e60553ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.259706:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf570dfe/0x4a426866e60553ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.259713:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf570dfe/0x4a426866e60553ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.259743:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788305972.260809:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305972.260819:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf570dfe/0x4a426866e60553ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.260828:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181682600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305972.260839:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf570dfe/0x4a426866e60553ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.260848:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf570dfe/0x4a426866e60553ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.260863:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf570dfe/0x4a426866e60553ac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.260870:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf570dfe/0x4a426866e60553ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.260889:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.260891:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.260892:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788305972.261004:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305972.261011:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052b2f73a/0x4a426866e60553b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.261022:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=802s v=(0 0) 00010000:00010000:3.0:1788305972.261026:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305972.261031:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052b2f73a/0x4a426866e60553b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.261042:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052b2f73a/0x4a426866e60553b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.261050:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052b2f73a/0x4a426866e60553b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.261057:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052b2f73a/0x4a426866e60553b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.261077:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788305972.261512:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305972.261518:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052b2f73a/0x4a426866e60553b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.261526:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181683000 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305972.261530:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052b2f73a/0x4a426866e60553b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.261538:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052b2f73a/0x4a426866e60553b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.261549:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052b2f73a/0x4a426866e60553b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.261618:0:24891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052b2f73a/0x4a426866e60553b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.261635:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.261637:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.261638:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788305972.262512:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305972.262522:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d51ee9a/0x4a426866e60553ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.262535:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=802s v=(0 0) 00010000:00010000:3.0:1788305972.262545:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305972.262552:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d51ee9a/0x4a426866e60553ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.262576:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d51ee9a/0x4a426866e60553ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.262584:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d51ee9a/0x4a426866e60553ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.262591:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d51ee9a/0x4a426866e60553ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.262607:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305972.262999:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305972.263007:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d51ee9a/0x4a426866e60553ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.263016:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181682a00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305972.263020:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d51ee9a/0x4a426866e60553ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.263029:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d51ee9a/0x4a426866e60553ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.263044:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d51ee9a/0x4a426866e60553ba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.263053:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d51ee9a/0x4a426866e60553ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.263082:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305972.263084:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305972.263085:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788305972.267230:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305972.267243:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc43caea/0x4a426866e60553c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.267260:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=802s v=(0 0) 00010000:00010000:0.0:1788305972.267264:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305972.267270:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc43caea/0x4a426866e60553c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.267341:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305972.267393:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc43caea/0x4a426866e60553c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.267404:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc43caea/0x4a426866e60553c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.267411:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc43caea/0x4a426866e60553c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.267470:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788305972.267994:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305972.268000:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000781e1cd5/0x4a426866e60553c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.268010:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=802s v=(0 0) 00010000:00010000:0.0:1788305972.268013:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305972.268017:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000781e1cd5/0x4a426866e60553c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.268035:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000781e1cd5/0x4a426866e60553c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.268042:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000781e1cd5/0x4a426866e60553c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.268049:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000781e1cd5/0x4a426866e60553c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788305972.272045:0:25048:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1788305972.272072:0:25048:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788305972.272077:0:25048:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788305972.272249:0:24697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23468:x1875174015382656:12345-0@lo:5:osp-pre-1-1.0 Request processed in 59367us (59515us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788305972.272260:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788305972.272342:0:23468:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788305972.272351:0:23468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23468:1875174015382656:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788305972.272367:0:23468:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1788305972.272426:0:23468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23468:1875174015382784:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788305972.272464:0:23468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305972.272491:0:23468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfae8600 going to sleep for 11 seconds 00000100:00100000:2.0:1788305972.272516:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015382784 00000100:00100000:2.0:1788305972.272521:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015382784 00000100:00100000:2.0:1788305972.272573:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788305972.272583:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23468:x1875174015382784:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788305972.272632:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23468:x1875174015382784:12345-0@lo:900:osp-pre-1-1.0 Request processed in 50us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305972.272652:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788305972.272685:0:23468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889188563800 x1875174015382784/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788305988 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305972.272696:0:23468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23468:1875174015382784:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1788305972.273143:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788305972.273154:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc43caea/0x4a426866e60553c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.273166:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9400 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305972.273171:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc43caea/0x4a426866e60553c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.273182:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc43caea/0x4a426866e60553c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.273205:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc43caea/0x4a426866e60553c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.273222:0:24891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc43caea/0x4a426866e60553c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.273248:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305972.273252:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000781e1cd5/0x4a426866e60553c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.273258:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8e00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305972.273261:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000781e1cd5/0x4a426866e60553c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.273268:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000781e1cd5/0x4a426866e60553c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.273300:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000781e1cd5/0x4a426866e60553c8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305972.273309:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305972.273311:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305972.273313:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305972.273487:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788305972.273495:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000781e1cd5/0x4a426866e60553c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.273642:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788305972.274143:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305972.274150:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a462779c/0x4a426866e60553cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.274164:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=802s v=(0 0) 00010000:00010000:0.0:1788305972.274168:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305972.274174:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a462779c/0x4a426866e60553cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.274188:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a462779c/0x4a426866e60553cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.274210:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a462779c/0x4a426866e60553cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.274217:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a462779c/0x4a426866e60553cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.274242:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788305972.274464:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305972.274470:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a462779c/0x4a426866e60553cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.274478:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9a00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305972.274483:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a462779c/0x4a426866e60553cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.274491:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a462779c/0x4a426866e60553cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.274506:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a462779c/0x4a426866e60553cf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.274513:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a462779c/0x4a426866e60553cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.274531:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.274533:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.274534:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788305972.274754:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305972.274760:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e60553d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.274769:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=802s v=(0 0) 00010000:00010000:0.0:1788305972.274773:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305972.274777:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e60553d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.274787:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e60553d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.274806:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e60553d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.274814:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e60553d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.274880:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788305972.275175:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305972.275180:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e60553dd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.275189:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=802s v=(0 0) 00010000:00010000:0.0:1788305972.275192:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305972.275197:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e60553dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.275206:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e60553dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.275213:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e60553dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.275220:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e60553dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.279100:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305972.279121:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e60553d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.279136:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9200 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305972.279141:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e60553d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.279153:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e60553d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.279174:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e60553d6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.279182:0:24891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e60553d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.279204:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305972.279207:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e60553dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.279214:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305972.279217:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e60553dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.279224:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e60553dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.279245:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e60553dd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.279253:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.279255:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.279257:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305972.279639:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788305972.279648:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e60553dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788305972.280176:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305972.280183:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e60553e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.280202:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=802s v=(0 0) 00010000:00010000:0.0:1788305972.280207:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305972.280213:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e60553e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.280226:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e60553e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.280235:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e60553e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.280243:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e60553e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.284831:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305972.284848:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e60553e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.284864:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9800 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305972.284870:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e60553e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.284880:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e60553e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.284904:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e60553e4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.284916:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.284918:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.284920:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305972.287146:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788305972.287164:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e60553e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.287730:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788305972.288458:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305972.288468:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016e29426/0x4a426866e60553eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.288483:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=802s v=(0 0) 00010000:00010000:0.0:1788305972.288488:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305972.288495:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016e29426/0x4a426866e60553eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.288520:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016e29426/0x4a426866e60553eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.288529:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016e29426/0x4a426866e60553eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.288536:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016e29426/0x4a426866e60553eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.292943:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788305972.295096:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305972.295126:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f73f17d/0x4a426866e60553f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.295144:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=802s v=(0 0) 00010000:00010000:0.0:1788305972.295148:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305972.295155:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f73f17d/0x4a426866e60553f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.295169:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f73f17d/0x4a426866e60553f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.295180:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f73f17d/0x4a426866e60553f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.295206:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f73f17d/0x4a426866e60553f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.296124:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305972.296135:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016e29426/0x4a426866e60553eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.296156:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8200 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305972.296161:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016e29426/0x4a426866e60553eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.296170:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016e29426/0x4a426866e60553eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.296189:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016e29426/0x4a426866e60553eb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.296195:0:24891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016e29426/0x4a426866e60553eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.296216:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305972.296220:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f73f17d/0x4a426866e60553f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.296226:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8a00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305972.296230:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f73f17d/0x4a426866e60553f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.296237:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f73f17d/0x4a426866e60553f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.296247:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f73f17d/0x4a426866e60553f2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.296262:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.296264:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.296266:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305972.298305:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788305972.298320:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f73f17d/0x4a426866e60553f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788305972.302322:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305972.302338:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e60553f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.302356:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=802s v=(0 0) 00010000:00010000:0.0:1788305972.302360:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305972.302366:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e60553f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.302379:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e60553f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.302389:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e60553f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.302396:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e60553f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.304500:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305972.304516:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e60553f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.304529:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9800 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305972.304534:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e60553f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.304543:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e60553f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.304574:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e60553f9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.304771:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788305972.304780:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e60553f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.305371:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788305972.305547:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305972.305565:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1b28352/0x4a426866e6055400 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.305579:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=802s v=(0 0) 00010000:00010000:2.0:1788305972.305583:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305972.305589:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1b28352/0x4a426866e6055400 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.305613:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1b28352/0x4a426866e6055400 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.305622:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1b28352/0x4a426866e6055400 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.305629:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1b28352/0x4a426866e6055400 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.305651:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305972.305949:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305972.305955:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1b28352/0x4a426866e6055400 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.305963:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebe00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305972.305967:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1b28352/0x4a426866e6055400 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.305976:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1b28352/0x4a426866e6055400 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.305991:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1b28352/0x4a426866e6055400 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.305998:0:24891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1b28352/0x4a426866e6055400 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.306014:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305972.306016:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305972.306018:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788305972.306256:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305972.306263:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f67ba84f/0x4a426866e6055407 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.306315:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=802s v=(0 0) 00010000:00010000:2.0:1788305972.306320:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305972.306326:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f67ba84f/0x4a426866e6055407 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.306337:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f67ba84f/0x4a426866e6055407 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.306346:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f67ba84f/0x4a426866e6055407 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.306364:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f67ba84f/0x4a426866e6055407 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.306382:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305972.306652:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305972.306664:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f67ba84f/0x4a426866e6055407 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.306671:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eba00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305972.306675:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f67ba84f/0x4a426866e6055407 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.306682:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f67ba84f/0x4a426866e6055407 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.306695:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f67ba84f/0x4a426866e6055407 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.306702:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f67ba84f/0x4a426866e6055407 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.306718:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305972.306721:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305972.306722:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305972.307325:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305972.307329:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305972.307330:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788305972.307366:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305972.307374:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000367614ca/0x4a426866e605540e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.307384:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=802s v=(0 0) 00010000:00010000:2.0:1788305972.307387:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305972.307392:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000367614ca/0x4a426866e605540e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.307403:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000367614ca/0x4a426866e605540e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.307411:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000367614ca/0x4a426866e605540e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.307418:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000367614ca/0x4a426866e605540e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.307573:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788305972.308203:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305972.308211:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7474ddd/0x4a426866e6055415 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.308228:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=802s v=(0 0) 00010000:00010000:2.0:1788305972.308231:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305972.308235:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7474ddd/0x4a426866e6055415 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.308245:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7474ddd/0x4a426866e6055415 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.308253:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7474ddd/0x4a426866e6055415 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.308261:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7474ddd/0x4a426866e6055415 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.308470:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788305972.308477:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000367614ca/0x4a426866e605540e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.308485:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183564000 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305972.308489:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000367614ca/0x4a426866e605540e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.308503:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000367614ca/0x4a426866e605540e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.308518:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000367614ca/0x4a426866e605540e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.308525:0:24891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000367614ca/0x4a426866e605540e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.308540:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305972.308543:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7474ddd/0x4a426866e6055415 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.308549:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183564800 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305972.308552:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7474ddd/0x4a426866e6055415 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.308663:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7474ddd/0x4a426866e6055415 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.308673:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7474ddd/0x4a426866e6055415 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.310249:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788305972.310263:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7474ddd/0x4a426866e6055415 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305972.310365:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305972.312211:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305972.312218:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305972.312221:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305972.312980:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788305972.312990:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000911fce86/0x4a426866e605541c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.313010:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=802s v=(0 0) 00010000:00010000:1.0:1788305972.313015:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305972.313022:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000911fce86/0x4a426866e605541c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.313037:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000911fce86/0x4a426866e605541c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.313047:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000911fce86/0x4a426866e605541c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.313055:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000911fce86/0x4a426866e605541c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.313084:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788305972.313417:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788305972.313430:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a132ac2e/0x4a426866e6055423 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.313440:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=802s v=(0 0) 00010000:00010000:1.0:1788305972.313443:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305972.313447:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a132ac2e/0x4a426866e6055423 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.313456:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a132ac2e/0x4a426866e6055423 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.313464:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a132ac2e/0x4a426866e6055423 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.313470:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a132ac2e/0x4a426866e6055423 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.313490:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788305972.313779:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305972.313787:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000911fce86/0x4a426866e605541c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.313807:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7dea00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305972.313813:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000911fce86/0x4a426866e605541c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.313835:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000911fce86/0x4a426866e605541c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.313852:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000911fce86/0x4a426866e605541c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.313859:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000911fce86/0x4a426866e605541c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.313878:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305972.313881:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a132ac2e/0x4a426866e6055423 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.313887:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7df000 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305972.313890:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a132ac2e/0x4a426866e6055423 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.313897:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a132ac2e/0x4a426866e6055423 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.313906:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a132ac2e/0x4a426866e6055423 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.313912:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a132ac2e/0x4a426866e6055423 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.313934:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.313935:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.313937:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305972.314008:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305972.314047:0:24232:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788305972.314053:0:24232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045a88a06/0x4a426866e605542a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.314061:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=802s v=(0 0) 00010000:00010000:1.0:1788305972.314064:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305972.314068:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045a88a06/0x4a426866e605542a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.314087:0:24232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045a88a06/0x4a426866e605542a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.314096:0:24232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045a88a06/0x4a426866e605542a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.314102:0:24232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045a88a06/0x4a426866e605542a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305972.314123:0:24232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788305972.314158:0:24232:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:1.0:1788305972.314257:0:24232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22748:x1875174015382400:12345-0@lo:5:osp-pre-1-0.0 Request processed in 115795us (117437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305972.314267:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1788305972.314366:0:24891:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305972.314372:0:24891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045a88a06/0x4a426866e605542a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.314380:0:24891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7dee00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305972.314383:0:24891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045a88a06/0x4a426866e605542a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.314390:0:24891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045a88a06/0x4a426866e605542a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.314401:0:24891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045a88a06/0x4a426866e605542a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.314407:0:24891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045a88a06/0x4a426866e605542a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305972.314419:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.314420:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305972.314422:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305972.314721:0:22748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e67480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22748:1875174015382400:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788305972.314738:0:22748:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1788305972.314783:0:22748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e67480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22748:1875174015382912:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788305972.314835:0:22748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305972.314865:0:22748:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b8f89a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305972.314986:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015382912 00000100:00100000:1.0:1788305972.314993:0:24231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015382912 00000100:00100000:1.0:1788305972.315039:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788305972.315047:0:24231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22748:x1875174015382912:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788305972.315084:0:24231:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:1.0:1788305972.316930:0:24231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22748:x1875174015382912:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1879us (2090us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788305972.316940:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788305972.316998:0:22748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e67480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22748:1875174015382912:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788305972.317012:0:22748:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:3.0:1788305972.950538:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788305973.724440:0:25404:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788305973.977373:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305974.230395:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788305974.230434:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015383040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305974.230511:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305974.233796:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015383040 00000100:00100000:3.0:1788305974.233812:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015383040 00000100:00100000:3.0:1788305974.233892:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788305974.233903:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015383040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788305974.233943:0:22726:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788305974.236882:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305974.236912:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015383168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305974.236995:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305974.237124:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015383168 00000100:00100000:2.0:1788305974.237133:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015383168 00000100:00100000:2.0:1788305974.237214:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788305974.237240:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015383168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788305974.237270:0:24235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788305974.237350:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015383168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305974.237358:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788305974.238799:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305974.238988:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015383168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305974.244543:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015383040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 10620us (14009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305974.244560:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788305974.247529:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015383040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305974.741603:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015383296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788305974.741682:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305974.741808:0:23464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015383296 00000100:00100000:2.0:1788305974.741816:0:23464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015383296 00000100:00100000:2.0:1788305974.741884:0:23464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788305974.741902:0:23464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015383296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788305974.741937:0:23464:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788305974.752541:0:23464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015383296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 10638us (10849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305974.752559:0:23464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788305974.752744:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015383296:0@lo:41:osp-pre-1-0.0 00000020:00000004:2.0:1788305974.923007:0:25456:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788305974.923728:0:25456:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788305975.010556:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305975.255371:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015383424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305975.255448:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305975.255537:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015383424 00000100:00100000:3.0:1788305975.255546:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015383424 00000100:00100000:3.0:1788305975.255623:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788305975.255633:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015383424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788305975.255657:0:24235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788305975.255698:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015383424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305975.255705:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788305975.255829:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305975.255873:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015383424:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1788305975.511025:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1788305975.801537:0:25506:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788305975.801857:0:25506:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788305976.028632:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305976.146190:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305976.146317:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994289920 00000100:00100000:1.0:1788305976.146327:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994289920 00000100:00100000:1.0:1788305976.146386:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 117 00000100:00100000:1.0:1788305976.146395:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2394:x1875173994289920:12345-192.168.202.55@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788305976.146431:0:22715:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3f8ba539-95ac-42db-9f6d-9f19c8062908@192.168.202.55@tcp t0 exp 0000000000000000 cur 806 last 0 00000020:00000080:1.0:1788305976.146461:0:22715:0:(genops.c:1385:class_connect()) connect: client 3f8ba539-95ac-42db-9f6d-9f19c8062908, cookie 0x4a426866e6055431 00000100:00080000:1.0:1788305976.146609:0:22715:0:(import.c:65:import_set_state_nolock()) ffff8890836cb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305976.146746:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8ba539-95ac-42db-9f6d-9f19c8062908+5:2394:x1875173994289920:12345-192.168.202.55@tcp:250:mount.lustre.0 Request processed in 350us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305976.146754:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 117 00000100:00100000:2.0:1788305976.155820:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305976.156028:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994290048 00000100:00100000:0.0:1788305976.156039:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994290048 00000100:00100000:0.0:1788305976.156151:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 118 00000100:00100000:0.0:1788305976.156163:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+5:18122:x1875173994290048:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788305976.156179:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305976.156211:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891903f8e00/0x4a426866e6055438 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0897a expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305976.156240:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891903f8e00/0x4a426866e6055438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0897a expref: 6 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305976.156250:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891903f8e00/0x4a426866e6055438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0897a expref: 6 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305976.156259:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8e00, rc 0) 00000100:00100000:0.0:1788305976.156375:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+6:18122:x1875173994290048:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 212us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305976.156382:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 118 00000100:00100000:2.0:1788305976.160942:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305976.161182:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994290176 00000100:00100000:0.0:1788305976.161206:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994290176 00000100:00100000:0.0:1788305976.161266:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 119 00000100:00100000:0.0:1788305976.161299:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+6:18122:x1875173994290176:12345-192.168.202.55@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788305976.161440:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+6:18122:x1875173994290176:12345-192.168.202.55@tcp:501:mount.lustre.0 Request processed in 164us (506us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788305976.161448:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 119 00000100:00100000:2.0:1788305976.165072:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305976.165589:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994290304 00000100:00100000:0.0:1788305976.165605:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994290304 00000100:00100000:0.0:1788305976.165685:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 120 00000100:00100000:0.0:1788305976.165698:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+6:18122:x1875173994290304:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788305976.165722:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305976.165746:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891903f8600/0x4a426866e605543f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08981 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305976.167913:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891903f8600/0x4a426866e605543f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08981 expref: 7 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305976.167939:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891903f8600/0x4a426866e605543f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08981 expref: 7 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305976.167951:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8600, rc 0) 00000100:00100000:0.0:1788305976.168058:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+7:18122:x1875173994290304:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 2360us (3001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305976.168069:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 120 00000100:00100000:2.0:1788305976.177727:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305976.180187:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994290432 00000100:00100000:1.0:1788305976.180210:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994290432 00000100:00100000:1.0:1788305976.180332:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 121 00000100:00100000:1.0:1788305976.180344:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8ba539-95ac-42db-9f6d-9f19c8062908+7:18122:x1875173994290432:12345-192.168.202.55@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788305976.180526:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8ba539-95ac-42db-9f6d-9f19c8062908+8:18122:x1875173994290432:12345-192.168.202.55@tcp:501:mount.lustre.0 Request processed in 184us (2813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305976.180535:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 121 00000100:00100000:2.0:1788305976.184308:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305976.184415:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994290560 00000100:00100000:0.0:1788305976.184426:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994290560 00000100:00100000:0.0:1788305976.184482:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 122 00000100:00100000:0.0:1788305976.184492:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a7d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+8:18122:x1875173994290560:12345-192.168.202.55@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788305976.185071:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a7d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+8:18122:x1875173994290560:12345-192.168.202.55@tcp:503:mount.lustre.0 Request processed in 578us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305976.185080:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 122 00000100:00100000:2.0:1788305976.196977:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305976.200857:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994290688 00000100:00100000:0.0:1788305976.200875:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994290688 00000100:00100000:0.0:1788305976.201117:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 123 00000100:00100000:0.0:1788305976.201129:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb34ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+8:18141:x1875173994290688:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788305976.201331:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb34ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+8:18141:x1875173994290688:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 204us (6061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305976.201340:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 123 00000100:00100000:2.0:1788305976.244784:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305976.244907:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994290816 00000100:00100000:1.0:1788305976.244917:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994290816 00000100:00100000:1.0:1788305976.244976:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 124 00000100:00100000:1.0:1788305976.244986:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb34a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8ba539-95ac-42db-9f6d-9f19c8062908+8:18141:x1875173994290816:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788305976.245141:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb34a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8ba539-95ac-42db-9f6d-9f19c8062908+8:18141:x1875173994290816:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 156us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305976.245150:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 124 00000100:00100000:1.0:1788305976.279154:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305976.279376:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994290944 00000100:00100000:0.0:1788305976.279385:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994290944 00000100:00100000:0.0:1788305976.279443:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 125 00000100:00100000:0.0:1788305976.279453:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb348c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+8:18141:x1875173994290944:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788305976.279619:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb348c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+8:18141:x1875173994290944:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 167us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305976.279627:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 125 00000100:00100000:3.0:1788305976.287565:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305976.287688:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994291072 00000100:00100000:2.0:1788305976.287698:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994291072 00000100:00100000:2.0:1788305976.287768:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 126 00000100:00100000:2.0:1788305976.287789:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb34a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+8:18122:x1875173994291072:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788305976.287806:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305976.287826:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889183565600/0x4a426866e6055446 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe089b2 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305976.287857:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183565600/0x4a426866e6055446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe089b2 expref: 9 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305976.287867:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889183565600/0x4a426866e6055446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe089b2 expref: 9 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305976.287877:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183565600, rc 0) 00000100:00100000:2.0:1788305976.287936:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb34a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+9:18122:x1875173994291072:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 159us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305976.287944:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 126 00000100:00100000:2.0:1788305976.293716:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305976.293953:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994291200 00000100:00100000:3.0:1788305976.293964:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994291200 00000100:00100000:3.0:1788305976.294023:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 127 00000100:00100000:3.0:1788305976.294034:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb348850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8ba539-95ac-42db-9f6d-9f19c8062908+9:18122:x1875173994291200:12345-192.168.202.55@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788305976.294060:0:22715:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788305976.294090:0:22715:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788305976.294094:0:22715:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788305976.294097:0:22715:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788305976.294099:0:22715:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788305976.294101:0:22715:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1788305976.302609:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb348850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8ba539-95ac-42db-9f6d-9f19c8062908+9:18122:x1875173994291200:12345-192.168.202.55@tcp:256:mount.lustre.0 Request processed in 8566us (8892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305976.302623:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 127 00000100:00100000:0.0:1788305976.312406:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305976.312539:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994291328 00000100:00100000:2.0:1788305976.312550:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994291328 00000100:00100000:2.0:1788305976.312623:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 128 00000100:00100000:2.0:1788305976.312634:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bbaab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+9:18122:x1875173994291328:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788305976.312649:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305976.312930:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889183565000/0x4a426866e605544d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe089b9 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305976.312970:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183565000/0x4a426866e605544d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe089b9 expref: 10 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305976.312998:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889183565000/0x4a426866e605544d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe089b9 expref: 10 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305976.313007:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183565000, rc 0) 00000100:00100000:3.0:1788305976.315606:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bbaab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+10:18122:x1875173994291328:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 2963us (3199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305976.315618:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 128 00000100:00100000:2.0:1788305976.318676:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305976.318837:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994291456 00000100:00100000:3.0:1788305976.318848:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994291456 00000100:00100000:3.0:1788305976.318907:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 129 00000100:00100000:3.0:1788305976.318918:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889190efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8ba539-95ac-42db-9f6d-9f19c8062908+10:18122:x1875173994291456:12345-192.168.202.55@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788305976.319085:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889190efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8ba539-95ac-42db-9f6d-9f19c8062908+10:18122:x1875173994291456:12345-192.168.202.55@tcp:501:mount.lustre.0 Request processed in 168us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305976.319093:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 129 00000100:00100000:1.0:1788305976.326378:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305976.326470:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994291584 00000100:00100000:3.0:1788305976.326480:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994291584 00000100:00100000:3.0:1788305976.326536:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 130 00000100:00100000:3.0:1788305976.326546:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+10:18122:x1875173994291584:12345-192.168.202.55@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788305976.326730:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+10:18122:x1875173994291584:12345-192.168.202.55@tcp:503:mount.lustre.0 Request processed in 184us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305976.326740:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 130 00000100:00100000:0.0:1788305976.333971:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305976.334269:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994291712 00000100:00100000:2.0:1788305976.334312:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994291712 00000100:00100000:2.0:1788305976.334370:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 131 00000100:00100000:2.0:1788305976.334381:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+10:18146:x1875173994291712:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788305976.334555:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+10:18146:x1875173994291712:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 175us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305976.334563:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 131 00000100:00100000:2.0:1788305976.354446:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305976.354572:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994291840 00000100:00100000:1.0:1788305976.354583:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994291840 00000100:00100000:1.0:1788305976.354640:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 132 00000100:00100000:1.0:1788305976.354651:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8ba539-95ac-42db-9f6d-9f19c8062908+10:18146:x1875173994291840:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788305976.354821:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8ba539-95ac-42db-9f6d-9f19c8062908+10:18146:x1875173994291840:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 170us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305976.354829:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 132 00000100:00100000:3.0:1788305976.380661:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305976.380753:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305976.381038:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994291968 00000100:00100000:0.0:1788305976.381047:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994291968 00000100:00100000:0.0:1788305976.381096:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994292224 00000100:00100000:0.0:1788305976.381100:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994292224 00000100:00100000:0.0:1788305976.381122:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:0.0:1788305976.381131:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875173994291968:12345-192.168.202.55@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788305976.381170:0:22722:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 82e7fd09-0853-4033-81ad-9c2ffd2628a0@192.168.202.55@tcp t0 exp 0000000000000000 cur 806 last 0 00000020:00000080:0.0:1788305976.381220:0:22722:0:(genops.c:1385:class_connect()) connect: client 82e7fd09-0853-4033-81ad-9c2ffd2628a0, cookie 0x4a426866e6055454 00000004:00100000:0.0:1788305976.381251:0:22722:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788305976.381481:0:22722:0:(import.c:65:import_set_state_nolock()) ffff88908334a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305976.381558:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:2394:x1875173994291968:12345-192.168.202.55@tcp:38:mount.lustre.0 Request processed in 425us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305976.381566:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:0.0:1788305976.381585:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:0.0:1788305976.381590:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875173994292224:12345-192.168.202.55@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788305976.381606:0:22722:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 82e7fd09-0853-4033-81ad-9c2ffd2628a0@192.168.202.55@tcp t0 exp 0000000000000000 cur 806 last 0 00000020:00000080:0.0:1788305976.381634:0:22722:0:(genops.c:1385:class_connect()) connect: client 82e7fd09-0853-4033-81ad-9c2ffd2628a0, cookie 0x4a426866e605545b 00000004:00100000:0.0:1788305976.381647:0:22722:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788305976.381785:0:22722:0:(import.c:65:import_set_state_nolock()) ffff889083349800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305976.381812:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:2394:x1875173994292224:12345-192.168.202.55@tcp:38:mount.lustre.0 Request processed in 220us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305976.381819:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:0.0:1788305976.392626:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305976.392673:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305976.392751:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994292096 00000100:00100000:3.0:1788305976.392771:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994292096 00000100:00100000:3.0:1788305976.392849:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994292352 00000100:00100000:3.0:1788305976.392853:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994292352 00000100:00100000:3.0:1788305976.392879:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:3.0:1788305976.392887:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:0:x1875173994292096:12345-192.168.202.55@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788305976.392925:0:23939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788305976.393007:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:0:x1875173994292096:12345-192.168.202.55@tcp:41:mount.lustre.0 Request processed in 120us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305976.393014:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:3.0:1788305976.393032:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:3.0:1788305976.393038:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:0:x1875173994292352:12345-192.168.202.55@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788305976.393055:0:23939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788305976.393089:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:0:x1875173994292352:12345-192.168.202.55@tcp:41:mount.lustre.0 Request processed in 52us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305976.393095:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00080000:0.0:1788305976.393305:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305976.393309:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305976.405673:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305976.405825:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994292480 00000100:00100000:3.0:1788305976.405836:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994292480 00000100:00100000:3.0:1788305976.405896:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:3.0:1788305976.405906:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:18122:x1875173994292480:12345-192.168.202.55@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788305976.405939:0:23939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788305976.406019:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:18122:x1875173994292480:12345-192.168.202.55@tcp:41:mount.lustre.0 Request processed in 114us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305976.406026:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:3.0:1788305976.408858:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305976.408976:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994292608 00000100:00100000:1.0:1788305976.408987:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994292608 00000100:00100000:1.0:1788305976.409053:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:1.0:1788305976.409064:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:18122:x1875173994292608:12345-192.168.202.55@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788305976.409162:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:18122:x1875173994292608:12345-192.168.202.55@tcp:40:mount.lustre.0 Request processed in 99us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305976.409169:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:2.0:1788305976.413117:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305976.413163:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305976.413198:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305976.413328:0:24697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994292736 00000100:00100000:0.0:1788305976.413338:0:24697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994292736 00000100:00100000:0.0:1788305976.413373:0:24697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994292864 00000100:00100000:0.0:1788305976.413376:0:24697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994292864 00000100:00100000:0.0:1788305976.413398:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:0.0:1788305976.413406:0:24697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1875173994292736:12345-192.168.202.55@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788305976.413456:0:24697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 82e7fd09-0853-4033-81ad-9c2ffd2628a0@192.168.202.55@tcp t0 exp 0000000000000000 cur 806 last 0 00000020:00000080:0.0:1788305976.413492:0:24697:0:(genops.c:1385:class_connect()) connect: client 82e7fd09-0853-4033-81ad-9c2ffd2628a0, cookie 0x4a426866e6055462 00002000:00100000:0.0:1788305976.413504:0:24697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 82e7fd09-0853-4033-81ad-9c2ffd2628a0/ffff88908334e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788305976.413532:0:24697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788305976.413700:0:24697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788305976.413729:0:24697:0:(import.c:65:import_set_state_nolock()) ffff88908334c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305976.413808:0:24697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:2394:x1875173994292736:12345-192.168.202.55@tcp:8:mount.lustre.0 Request processed in 399us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305976.413816:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:0.0:1788305976.413833:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:0.0:1788305976.413837:0:24697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1875173994292864:12345-192.168.202.55@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788305976.413854:0:24697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 82e7fd09-0853-4033-81ad-9c2ffd2628a0@192.168.202.55@tcp t0 exp 0000000000000000 cur 806 last 0 00000020:00000080:0.0:1788305976.413871:0:24697:0:(genops.c:1385:class_connect()) connect: client 82e7fd09-0853-4033-81ad-9c2ffd2628a0, cookie 0x4a426866e6055469 00002000:00100000:0.0:1788305976.413876:0:24697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 82e7fd09-0853-4033-81ad-9c2ffd2628a0/ffff889083348800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788305976.413887:0:24697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788305976.414001:0:24697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788305976.414019:0:24697:0:(import.c:65:import_set_state_nolock()) ffff889083349000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305976.414043:0:24697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:2394:x1875173994292864:12345-192.168.202.55@tcp:8:mount.lustre.0 Request processed in 204us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305976.414050:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:3.0:1788305976.414456:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994292992 00000100:00100000:3.0:1788305976.414469:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994292992 00000100:00100000:3.0:1788305976.414515:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:3.0:1788305976.414534:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:18122:x1875173994292992:12345-192.168.202.55@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788305976.414585:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:18122:x1875173994292992:12345-192.168.202.55@tcp:900:mount.lustre.0 Request processed in 53us (1385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305976.414592:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:2.0:1788305976.423994:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305976.424106:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994293120 00000100:00100000:0.0:1788305976.424116:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994293120 00000100:00100000:0.0:1788305976.424181:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:0.0:1788305976.424192:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:18122:x1875173994293120:12345-192.168.202.55@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788305976.427703:0:22724:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2790us 00000004:00200000:3.0:1788305976.471767:0:22724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788305976.471905:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:18122:x1875173994293120:12345-192.168.202.55@tcp:33:mount.lustre.0 Request processed in 47709us (47915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305976.471921:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:1.0:1788305976.707452:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305976.707776:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994293248 00000100:00100000:3.0:1788305976.707787:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994293248 00000100:00100000:3.0:1788305976.707967:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:3.0:1788305976.707978:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:18169:x1875173994293248:12345-192.168.202.55@tcp:101:mkdir.0 00010000:00010000:3.0:1788305976.707999:0:23939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305976.708026:0:23939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181683000/0x4a426866e6055470 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe089ea expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305976.708099:0:23939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181682600/0x4a426866e6055477 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305976.708114:0:23939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181682600/0x4a426866e6055477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305976.708129:0:23939:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181682600/0x4a426866e6055477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305976.708189:0:23939:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788305976.708206:0:23939:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788305976.708252:0:23939:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889181682600/0x4a426866e6055477 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305976.708338:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181683000/0x4a426866e6055470 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe089ea expref: 8 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305976.708358:0:23939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181682600/0x4a426866e6055477 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe089ea expref: 7 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305976.708367:0:23939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88918c769b00) 00010000:00010000:3.0:1788305976.708371:0:23939:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788305976.708375:0:23939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181682600, rc 0) 00000100:00100000:3.0:1788305976.708655:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+7:18169:x1875173994293248:12345-192.168.202.55@tcp:101:mkdir.0 Request processed in 678us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305976.708663:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 13 00010000:00010000:1.0:1788305977.045460:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305977.303213:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305977.303239:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015383552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305977.303344:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305977.303438:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015383552 00000100:00100000:1.0:1788305977.303462:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015383552 00000100:00100000:1.0:1788305977.303533:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788305977.303543:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875174015383552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788305977.303579:0:24235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788305977.303621:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875174015383552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305977.303628:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788305977.303664:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4402ecd-e8a2-4271-82d7-771a7bb97982:3650:1875174015383680:0@lo:400:kworker.0 00000100:00100000:1.0:1788305977.303722:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305977.303769:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015384192:0@lo:400:kworker.0 00000100:00100000:1.0:1788305977.303797:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305977.303824:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015383936:0@lo:400:kworker.0 00000100:00100000:0.0:1788305977.303926:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015384064:0@lo:400:kworker.0 00000100:00100000:0.0:1788305977.303968:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305977.303989:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015384576:0@lo:400:kworker.0 00000100:00100000:0.0:1788305977.304009:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305977.304028:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015385088:0@lo:400:kworker.0 00000100:00100000:0.0:1788305977.304052:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305977.304072:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305977.304079:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015384704:0@lo:400:kworker.0 00000100:00100000:0.0:1788305977.304101:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305977.306214:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015383552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305977.310412:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305977.310441:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015385216:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305977.310508:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788305977.310687:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788305977.310703:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015383808:0@lo:400:kworker.0 00000100:00100000:0.0:1788305977.310734:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305977.310766:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015384320:0@lo:400:kworker.0 00000100:00100000:0.0:1788305977.310793:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305977.310811:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015384832:0@lo:400:kworker.0 00000100:00100000:0.0:1788305977.310833:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305977.314009:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305977.314106:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015384448:0@lo:400:kworker.0 00000100:00100000:3.0:1788305977.314181:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305977.314213:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015384960:0@lo:400:kworker.0 00000100:00100000:3.0:1788305977.314288:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015384192 00000100:00100000:3.0:1788305977.314300:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015384192 00000100:00100000:3.0:1788305977.314356:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015383808 00000100:00100000:3.0:1788305977.314360:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015383808 00000100:00100000:3.0:1788305977.314380:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788305977.314410:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015384192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305977.314483:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015384192:12345-0@lo:400:kworker.0 Request processed in 92us (10683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305977.314509:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788305977.314832:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788305977.314840:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015383808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305977.314989:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015383808:12345-0@lo:400:kworker.0 Request processed in 149us (4253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305977.314997:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788305977.323969:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015384320 00000100:00100000:0.0:1788305977.323986:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015384320 00000100:00100000:0.0:1788305977.324061:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015383936 00000100:00100000:0.0:1788305977.324064:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015383936 00000100:00100000:0.0:1788305977.324084:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015384448 00000100:00100000:0.0:1788305977.324087:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015384448 00000100:00100000:0.0:1788305977.324109:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788305977.324133:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015384320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305977.324213:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015384320:12345-0@lo:400:kworker.0 Request processed in 82us (13418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305977.324221:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788305977.324250:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788305977.324256:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb357800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015383936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305977.324307:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb357800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015383936:12345-0@lo:400:kworker.0 Request processed in 51us (10311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305977.324312:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788305977.324322:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305977.324327:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015384448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305977.324349:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015384448:12345-0@lo:400:kworker.0 Request processed in 23us (10169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305977.324354:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788305977.324376:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305977.324380:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305977.324388:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015385216 00000100:00100000:0.0:1788305977.324392:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015385216 00000100:00100000:0.0:1788305977.324413:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788305977.324419:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015385216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788305977.324433:0:24235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788305977.324470:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015385216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (13962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305977.324475:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788305977.324518:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015385216:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305977.324571:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015383808:0@lo:400:kworker.0 00000100:00100000:0.0:1788305977.324592:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015384320:0@lo:400:kworker.0 00000100:00100000:1.0:1788305977.328695:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015384064 00000100:00100000:1.0:1788305977.328711:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015384064 00000100:00100000:1.0:1788305977.328803:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015384576 00000100:00100000:1.0:1788305977.328807:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015384576 00000100:00100000:1.0:1788305977.328822:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015385088 00000100:00100000:1.0:1788305977.328825:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015385088 00000100:00080000:1.0:1788305977.328857:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788305977.328874:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015384704 00000100:00100000:1.0:1788305977.328877:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015384704 00000100:00080000:1.0:1788305977.328889:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305977.328901:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015384832 00000100:00100000:1.0:1788305977.328904:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015384832 00000100:00080000:1.0:1788305977.328916:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788305977.328934:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788305977.328943:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015384064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305977.329041:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015384064:12345-0@lo:400:kworker.0 Request processed in 98us (25071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305977.329062:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788305977.329113:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015384064:0@lo:400:kworker.0 00000100:00100000:1.0:1788305977.329142:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788305977.329149:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015384576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305977.329183:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015384576:12345-0@lo:400:kworker.0 Request processed in 35us (25173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305977.329189:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788305977.329215:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015384576:0@lo:400:kworker.0 00000100:00100000:1.0:1788305977.329248:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788305977.329255:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015385088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305977.329317:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015385088:12345-0@lo:400:kworker.0 Request processed in 63us (25264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305977.329323:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788305977.329349:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb356a00 x1875174015385088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305977.329360:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015385088:0@lo:400:kworker.0 00000100:00100000:1.0:1788305977.329376:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788305977.329383:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015384704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305977.329413:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015384704:12345-0@lo:400:kworker.0 Request processed in 31us (25311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305977.329418:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788305977.329438:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015384704:0@lo:400:kworker.0 00000100:00100000:1.0:1788305977.329452:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788305977.329466:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015384832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305977.329513:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015384832:12345-0@lo:400:kworker.0 Request processed in 48us (18679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305977.329518:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788305977.329541:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb354000 x1875174015384832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305977.329562:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015384832:0@lo:400:kworker.0 00000100:00100000:1.0:1788305977.329608:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015384192:0@lo:400:kworker.0 00000100:00100000:1.0:1788305977.329644:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015383680 00000100:00100000:1.0:1788305977.329647:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015383680 00000100:00100000:1.0:1788305977.329673:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788305977.329679:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:3650:x1875174015383680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305977.329714:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:3650:x1875174015383680:12345-0@lo:400:kworker.0 Request processed in 35us (25994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305977.329720:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788305977.329765:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4402ecd-e8a2-4271-82d7-771a7bb97982:3650:1875174015383680:0@lo:400:kworker.0 00000100:00100000:2.0:1788305977.336719:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305977.336832:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015383936:0@lo:400:kworker.0 00000100:00100000:2.0:1788305977.336851:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015384448:0@lo:400:kworker.0 00000100:00100000:1.0:1788305977.336963:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015384960 00000100:00100000:1.0:1788305977.336970:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015384960 00000100:00100000:1.0:1788305977.337036:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788305977.337045:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015384960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305977.337122:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015384960:12345-0@lo:400:kworker.0 Request processed in 78us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305977.337129:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788305977.339464:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015384960:0@lo:400:kworker.0 00000100:00080000:2.0:1788305977.339501:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1788305977.819832:0:25048:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 82e7fd09-0853-4033-81ad-9c2ffd2628a0 00000001:00080000:0.0:1788305977.819855:0:25048:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:2.0:1788305978.070259:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305978.913409:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305978.913663:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994293376 00000100:00100000:2.0:1788305978.913677:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994293376 00000100:00100000:2.0:1788305978.913801:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:2.0:1788305978.913816:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+7:18221:x1875173994293376:12345-192.168.202.55@tcp:41:lfs.0 00000004:00000024:2.0:1788305978.913873:0:22723:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788305978.914269:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+7:18221:x1875173994293376:12345-192.168.202.55@tcp:41:lfs.0 Request processed in 455us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305978.914318:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00080000:3.0:1788305978.914417:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305978.919544:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305978.919918:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994293504 00000100:00100000:1.0:1788305978.919933:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994293504 00000100:00100000:1.0:1788305978.920110:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:1.0:1788305978.920125:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:18221:x1875173994293504:12345-192.168.202.55@tcp:41:lfs.0 00000004:00000024:1.0:1788305978.920199:0:22721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788305978.920952:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:18221:x1875173994293504:12345-192.168.202.55@tcp:41:lfs.0 Request processed in 824us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305978.920963:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00080000:3.0:1788305978.929046:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788305978.929822:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305978.930010:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994293632 00000100:00100000:0.0:1788305978.930024:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994293632 00000100:00100000:0.0:1788305978.930119:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:0.0:1788305978.930131:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:18221:x1875173994293632:12345-192.168.202.55@tcp:13:lfs.0 00002000:00000024:0.0:1788305978.930173:0:24235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788305978.930328:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:18221:x1875173994293632:12345-192.168.202.55@tcp:13:lfs.0 Request processed in 198us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305978.930337:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00080000:3.0:1788305978.932620:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305978.946107:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305978.949797:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994293760 00000100:00100000:1.0:1788305978.949822:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994293760 00000100:00100000:1.0:1788305978.950045:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:1.0:1788305978.950061:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:82e7fd09-0853-4033-81ad-9c2ffd2628a0+5:18221:x1875173994293760:12345-192.168.202.55@tcp:13:lfs.0 00002000:00000024:1.0:1788305978.950108:0:24235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788305978.950248:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:82e7fd09-0853-4033-81ad-9c2ffd2628a0+5:18221:x1875173994293760:12345-192.168.202.55@tcp:13:lfs.0 Request processed in 189us (4156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305978.950258:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00080000:3.0:1788305978.958878:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788305979.094870:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305979.201836:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305979.202648:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994293888 00000100:00100000:0.0:1788305979.202665:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994293888 00000100:00100000:0.0:1788305979.202764:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 134 00000100:00100000:0.0:1788305979.202778:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+10:18253:x1875173994293888:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788305979.202804:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305979.202829:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891903f9a00/0x4a426866e605547e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe089f1 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305979.202873:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891903f9a00/0x4a426866e605547e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe089f1 expref: 11 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305979.202886:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891903f9a00/0x4a426866e605547e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe089f1 expref: 11 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305979.202898:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9a00, rc 0) 00000100:00100000:0.0:1788305979.203021:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+11:18253:x1875173994293888:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 245us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305979.203029:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 134 00000100:00100000:0.0:1788305979.223138:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305979.223312:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994294016 00000100:00100000:1.0:1788305979.223326:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994294016 00000100:00100000:1.0:1788305979.223412:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 135 00000100:00100000:1.0:1788305979.223426:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8ba539-95ac-42db-9f6d-9f19c8062908+11:18253:x1875173994294016:12345-192.168.202.55@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788305979.223872:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8ba539-95ac-42db-9f6d-9f19c8062908+11:18253:x1875173994294016:12345-192.168.202.55@tcp:501:mount.lustre.0 Request processed in 447us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305979.223882:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 135 00000100:00100000:0.0:1788305979.233413:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305979.233793:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994294144 00000100:00100000:1.0:1788305979.233807:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994294144 00000100:00100000:1.0:1788305979.233891:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 136 00000100:00100000:1.0:1788305979.233915:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+11:18253:x1875173994294144:12345-192.168.202.55@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788305979.240263:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+11:18253:x1875173994294144:12345-192.168.202.55@tcp:503:mount.lustre.0 Request processed in 6338us (6858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305979.240312:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 136 00000100:00100000:2.0:1788305979.261257:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305979.261654:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994294272 00000100:00100000:0.0:1788305979.261668:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994294272 00000100:00100000:0.0:1788305979.261752:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 137 00000100:00100000:0.0:1788305979.261765:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+11:18260:x1875173994294272:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788305979.262040:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+11:18260:x1875173994294272:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 276us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305979.262050:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 137 00000100:00100000:0.0:1788305979.314882:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305979.315034:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994294400 00000100:00100000:1.0:1788305979.315050:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994294400 00000100:00100000:1.0:1788305979.315128:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 138 00000100:00100000:1.0:1788305979.315141:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+11:18260:x1875173994294400:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788305979.315416:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+11:18260:x1875173994294400:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 277us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305979.315425:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 138 00000100:00100000:3.0:1788305979.323713:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305979.324603:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994294528 00000100:00100000:2.0:1788305979.324623:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994294528 00000100:00100000:2.0:1788305979.324721:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 139 00000100:00100000:2.0:1788305979.324747:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8ba539-95ac-42db-9f6d-9f19c8062908+11:18260:x1875173994294528:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788305979.325716:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8ba539-95ac-42db-9f6d-9f19c8062908+11:18260:x1875173994294528:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 976us (2002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305979.325730:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 139 00000100:00100000:2.0:1788305979.329476:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305979.330817:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994294656 00000100:00100000:0.0:1788305979.330832:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994294656 00000100:00100000:0.0:1788305979.331009:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 140 00000100:00100000:0.0:1788305979.331020:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+11:18253:x1875173994294656:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788305979.331038:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305979.331057:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891903f9800/0x4a426866e6055485 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08a22 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305979.331089:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891903f9800/0x4a426866e6055485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a22 expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305979.331102:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891903f9800/0x4a426866e6055485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a22 expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305979.331133:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9800, rc 0) 00000100:00100000:0.0:1788305979.331225:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+12:18253:x1875173994294656:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 206us (1759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305979.331232:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 140 00000100:00100000:3.0:1788305979.335606:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305979.335722:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994294784 00000100:00100000:1.0:1788305979.335742:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994294784 00000100:00100000:1.0:1788305979.335805:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 141 00000100:00100000:1.0:1788305979.335815:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+12:18253:x1875173994294784:12345-192.168.202.55@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788305979.335842:0:22716:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788305979.335877:0:22716:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788305979.335882:0:22716:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788305979.335885:0:22716:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788305979.335888:0:22716:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788305979.335890:0:22716:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1788305979.338334:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+12:18253:x1875173994294784:12345-192.168.202.55@tcp:256:mount.lustre.0 Request processed in 2510us (2728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305979.338349:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 141 00000100:00100000:3.0:1788305979.343968:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305979.345095:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994294912 00000100:00100000:0.0:1788305979.345106:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994294912 00000100:00100000:0.0:1788305979.345482:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 142 00000100:00100000:0.0:1788305979.345494:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+12:18253:x1875173994294912:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788305979.345531:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305979.345550:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891903f8a00/0x4a426866e605548c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08a29 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305979.345581:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891903f8a00/0x4a426866e605548c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a29 expref: 13 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305979.345591:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891903f8a00/0x4a426866e605548c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a29 expref: 13 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305979.345601:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8a00, rc 0) 00000100:00100000:0.0:1788305979.345667:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+13:18253:x1875173994294912:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 175us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305979.345674:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 142 00000100:00100000:1.0:1788305979.349727:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015385344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788305979.349810:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305979.349992:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015385344 00000100:00100000:3.0:1788305979.350001:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015385344 00000100:00100000:3.0:1788305979.350053:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788305979.350063:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015385344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788305979.350088:0:22726:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788305979.350156:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015385344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305979.350164:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788305979.350458:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015385344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305979.352006:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015385472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305979.352055:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305979.353077:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015385472 00000100:00100000:0.0:1788305979.353088:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015385472 00000100:00100000:0.0:1788305979.353168:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788305979.353189:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015385472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305979.353222:0:24235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1788305979.353307:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305979.353447:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015385472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 260us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305979.353455:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788305979.353469:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015385472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305979.354509:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305979.354929:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994295040 00000100:00100000:1.0:1788305979.354938:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994295040 00000100:00100000:1.0:1788305979.355040:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 143 00000100:00100000:1.0:1788305979.355059:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+13:18253:x1875173994295040:12345-192.168.202.55@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788305979.355216:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+13:18253:x1875173994295040:12345-192.168.202.55@tcp:501:mount.lustre.0 Request processed in 149us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305979.355225:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 143 00000100:00100000:3.0:1788305979.362943:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305979.364462:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994295168 00000100:00100000:0.0:1788305979.364475:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994295168 00000100:00100000:0.0:1788305979.364606:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 144 00000100:00100000:0.0:1788305979.364618:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+13:18253:x1875173994295168:12345-192.168.202.55@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788305979.364797:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+13:18253:x1875173994295168:12345-192.168.202.55@tcp:503:mount.lustre.0 Request processed in 180us (1860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305979.364806:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 144 00000100:00100000:3.0:1788305979.369932:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305979.370360:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994295296 00000100:00100000:1.0:1788305979.370370:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994295296 00000100:00100000:1.0:1788305979.370427:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 145 00000100:00100000:1.0:1788305979.370449:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+13:18266:x1875173994295296:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788305979.370756:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+13:18266:x1875173994295296:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 317us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305979.370766:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 145 00000100:00100000:3.0:1788305979.373877:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305979.374228:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994295424 00000100:00100000:1.0:1788305979.374238:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994295424 00000100:00100000:1.0:1788305979.374338:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 146 00000100:00100000:1.0:1788305979.374350:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+13:18266:x1875173994295424:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788305979.374760:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+13:18266:x1875173994295424:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 411us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305979.374769:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 146 00000100:00100000:3.0:1788305979.391426:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305979.391644:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305979.397317:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994295552 00000100:00100000:0.0:1788305979.397333:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994295552 00000100:00100000:0.0:1788305979.397451:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994295808 00000100:00100000:0.0:1788305979.397454:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994295808 00000100:00100000:0.0:1788305979.397477:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:0.0:1788305979.397487:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875173994295552:12345-192.168.202.55@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788305979.397516:0:22722:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 8e482d8f-ec3a-4afe-a831-3f7381c98170@192.168.202.55@tcp t0 exp 0000000000000000 cur 809 last 0 00000020:00000080:0.0:1788305979.397556:0:22722:0:(genops.c:1385:class_connect()) connect: client 8e482d8f-ec3a-4afe-a831-3f7381c98170, cookie 0x4a426866e6055493 00000100:00100000:3.0:1788305979.399265:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:3.0:1788305979.399299:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875173994295808:12345-192.168.202.55@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788305979.399329:0:23939:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 8e482d8f-ec3a-4afe-a831-3f7381c98170@192.168.202.55@tcp t0 exp 0000000000000000 cur 809 last 0 00000020:00000080:3.0:1788305979.399364:0:23939:0:(genops.c:1385:class_connect()) connect: client 8e482d8f-ec3a-4afe-a831-3f7381c98170, cookie 0x4a426866e605549a 00000004:00100000:3.0:1788305979.399391:0:23939:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788305979.399501:0:23939:0:(import.c:65:import_set_state_nolock()) ffff8890837e2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788305979.399587:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:2394:x1875173994295808:12345-192.168.202.55@tcp:38:mount.lustre.0 Request processed in 310us (7942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305979.399595:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 17 00000004:00100000:0.0:1788305979.401154:0:22722:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788305979.401250:0:22722:0:(import.c:65:import_set_state_nolock()) ffff8891c123e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305979.401334:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:2394:x1875173994295552:12345-192.168.202.55@tcp:38:mount.lustre.0 Request processed in 3846us (9916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305979.401343:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:0.0:1788305979.419854:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305979.419900:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305979.420061:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305979.430386:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994295936 00000100:00100000:1.0:1788305979.430404:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994295936 00000100:00100000:1.0:1788305979.430482:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994295680 00000100:00100000:1.0:1788305979.430500:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994295680 00000100:00100000:1.0:1788305979.430521:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994296064 00000100:00100000:1.0:1788305979.430524:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994296064 00000100:00100000:1.0:1788305979.430542:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:1.0:1788305979.430551:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:0:x1875173994295936:12345-192.168.202.55@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788305979.430594:0:22721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788305979.430663:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:0:x1875173994295936:12345-192.168.202.55@tcp:41:mount.lustre.0 Request processed in 112us (10818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305979.430671:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:1.0:1788305979.430690:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:1.0:1788305979.430697:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e482d8f-ec3a-4afe-a831-3f7381c98170+7:0:x1875173994295680:12345-192.168.202.55@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788305979.430709:0:22721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788305979.430749:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e482d8f-ec3a-4afe-a831-3f7381c98170+7:0:x1875173994295680:12345-192.168.202.55@tcp:41:mount.lustre.0 Request processed in 53us (10848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305979.430755:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:1.0:1788305979.430767:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:1.0:1788305979.430773:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:18253:x1875173994296064:12345-192.168.202.55@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788305979.430784:0:22721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788305979.430806:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:18253:x1875173994296064:12345-192.168.202.55@tcp:41:mount.lustre.0 Request processed in 32us (10744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305979.430811:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00080000:1.0:1788305979.430830:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788305979.430833:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788305979.434556:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305979.434666:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994296192 00000100:00100000:1.0:1788305979.434674:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994296192 00000100:00100000:1.0:1788305979.434739:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:1.0:1788305979.434766:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:18253:x1875173994296192:12345-192.168.202.55@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788305979.434870:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:18253:x1875173994296192:12345-192.168.202.55@tcp:40:mount.lustre.0 Request processed in 106us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305979.434877:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:0.0:1788305979.438385:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305979.438478:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994296576 00000100:00100000:3.0:1788305979.438487:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994296576 00000100:00100000:3.0:1788305979.438594:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:3.0:1788305979.438607:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:18253:x1875173994296576:12345-192.168.202.55@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788305979.438691:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:18253:x1875173994296576:12345-192.168.202.55@tcp:900:mount.lustre.0 Request processed in 87us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305979.438699:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:0.0:1788305979.440805:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305979.440837:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305979.440909:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305979.441469:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994296704 00000100:00100000:3.0:1788305979.441478:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994296704 00000100:00100000:3.0:1788305979.441611:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 1 00000100:00100000:3.0:1788305979.441622:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:18253:x1875173994296704:12345-192.168.202.55@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788305979.441709:0:22725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788305979.441840:0:24697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994296320 00000100:00100000:1.0:1788305979.441846:0:24697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994296320 00000100:00100000:1.0:1788305979.441879:0:24697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994296448 00000100:00100000:1.0:1788305979.441882:0:24697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994296448 00000100:00100000:1.0:1788305979.441896:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:1.0:1788305979.441902:0:24697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1875173994296320:12345-192.168.202.55@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788305979.441929:0:24697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 8e482d8f-ec3a-4afe-a831-3f7381c98170@192.168.202.55@tcp t0 exp 0000000000000000 cur 809 last 0 00000020:00000080:1.0:1788305979.441961:0:24697:0:(genops.c:1385:class_connect()) connect: client 8e482d8f-ec3a-4afe-a831-3f7381c98170, cookie 0x4a426866e60554a1 00002000:00100000:1.0:1788305979.441972:0:24697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8e482d8f-ec3a-4afe-a831-3f7381c98170/ffff8890836ce000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788305979.441984:0:24697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788305979.442052:0:24697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788305979.442093:0:24697:0:(import.c:65:import_set_state_nolock()) ffff889083cc6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305979.442234:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:0.0:1788305979.442240:0:24232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2394:x1875173994296448:12345-192.168.202.55@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788305979.442257:0:24232:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 8e482d8f-ec3a-4afe-a831-3f7381c98170@192.168.202.55@tcp t0 exp 0000000000000000 cur 809 last 0 00000020:00000080:0.0:1788305979.442296:0:24232:0:(genops.c:1385:class_connect()) connect: client 8e482d8f-ec3a-4afe-a831-3f7381c98170, cookie 0x4a426866e60554a8 00002000:00100000:0.0:1788305979.442302:0:24232:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8e482d8f-ec3a-4afe-a831-3f7381c98170/ffff8891c1239000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788305979.442307:0:24232:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788305979.442348:0:24232:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788305979.442362:0:24232:0:(import.c:65:import_set_state_nolock()) ffff8891c123e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788305979.442790:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:18253:x1875173994296704:12345-192.168.202.55@tcp:33:mount.lustre.0 Request processed in 1167us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305979.442799:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 1 00000100:00100000:1.0:1788305979.442888:0:24697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:2394:x1875173994296320:12345-192.168.202.55@tcp:8:mount.lustre.0 Request processed in 984us (2087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305979.442895:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:0.0:1788305979.442976:0:24232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:2394:x1875173994296448:12345-192.168.202.55@tcp:8:mount.lustre.0 Request processed in 734us (2137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305979.442984:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:2.0:1788305979.681221:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305979.681414:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994296832 00000100:00100000:3.0:1788305979.681425:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994296832 00000100:00100000:3.0:1788305979.681486:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:3.0:1788305979.681508:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:18289:x1875173994296832:12345-192.168.202.55@tcp:101:mkdir.0 00010000:00010000:3.0:1788305979.681531:0:23939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305979.681555:0:23939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181682e00/0x4a426866e60554af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08a5a expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305979.681625:0:23939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181683000/0x4a426866e60554b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305979.681639:0:23939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181683000/0x4a426866e60554b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305979.681650:0:23939:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181683000/0x4a426866e60554b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305979.681699:0:23939:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788305979.681703:0:23939:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788305979.681724:0:23939:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889181683000/0x4a426866e60554b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305979.681763:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181682e00/0x4a426866e60554af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a5a expref: 8 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305979.681797:0:23939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181683000/0x4a426866e60554b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a5a expref: 7 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305979.681806:0:23939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88918c769b00) 00010000:00010000:3.0:1788305979.681809:0:23939:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788305979.681813:0:23939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181683000, rc 0) 00000100:00100000:3.0:1788305979.681874:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e482d8f-ec3a-4afe-a831-3f7381c98170+7:18289:x1875173994296832:12345-192.168.202.55@tcp:101:mkdir.0 Request processed in 379us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305979.681880:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:1.0:1788305979.863401:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015385600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788305979.863505:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305979.863958:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015385600 00000100:00100000:0.0:1788305979.863967:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015385600 00000100:00100000:0.0:1788305979.864024:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788305979.864035:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015385600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788305979.864074:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788305979.864135:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015385600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305979.864142:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788305979.864216:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015385600:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788305980.117449:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305980.373982:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305980.374007:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015385728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788305980.374094:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305980.374202:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015385728 00000100:00100000:3.0:1788305980.374211:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015385728 00000100:00100000:3.0:1788305980.374299:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788305980.374309:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb23f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015385728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788305980.374333:0:24234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788305980.374382:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb23f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015385728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305980.374389:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788305980.374431:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015385728:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788305980.374507:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788305980.503339:0:22756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788305981.143342:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788305981.914618:0:23456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8e482d8f-ec3a-4afe-a831-3f7381c98170 00000001:00100000:3.0:1788305981.914632:0:23456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 82e7fd09-0853-4033-81ad-9c2ffd2628a0 00000001:00100000:0.0:1788305981.915866:0:24227:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8e482d8f-ec3a-4afe-a831-3f7381c98170 00000001:00100000:0.0:1788305981.915883:0:24227:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 82e7fd09-0853-4033-81ad-9c2ffd2628a0 00000001:00100000:1.0:1788305981.917791:0:22702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8e482d8f-ec3a-4afe-a831-3f7381c98170 00000001:00100000:1.0:1788305981.917803:0:22702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 82e7fd09-0853-4033-81ad-9c2ffd2628a0 00010000:00010000:0.0:1788305982.167672:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305982.424035:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015385984:0@lo:400:kworker.0 00000100:00100000:3.0:1788305982.424103:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305982.424151:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015386496:0@lo:400:kworker.0 00000100:00100000:3.0:1788305982.424174:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305982.424203:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015387008:0@lo:400:kworker.0 00000100:00100000:3.0:1788305982.424227:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305982.424247:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788305982.424253:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4402ecd-e8a2-4271-82d7-771a7bb97982:3648:1875174015385856:0@lo:400:kworker.0 00000100:00100000:3.0:1788305982.424297:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305982.424327:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015386368:0@lo:400:kworker.0 00000100:00100000:3.0:1788305982.427205:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305982.427247:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015386880:0@lo:400:kworker.0 00000100:00100000:3.0:1788305982.427290:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305982.427310:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015387392:0@lo:400:kworker.0 00000100:00100000:0.0:1788305982.428852:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015385856 00000100:00100000:0.0:1788305982.428865:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015385856 00000100:00100000:0.0:1788305982.429068:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788305982.429079:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:3648:x1875174015385856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305982.429158:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:3648:x1875174015385856:12345-0@lo:400:kworker.0 Request processed in 81us (4860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305982.429166:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788305982.430489:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305982.430561:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015387520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305982.430611:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305982.430653:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4402ecd-e8a2-4271-82d7-771a7bb97982:3648:1875174015385856:0@lo:400:kworker.0 00000100:00100000:3.0:1788305982.430688:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015386112:0@lo:400:kworker.0 00000100:00100000:3.0:1788305982.430731:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305982.430752:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015386624:0@lo:400:kworker.0 00000100:00100000:3.0:1788305982.430772:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305982.430788:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015387136:0@lo:400:kworker.0 00000100:00100000:3.0:1788305982.430833:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305982.430851:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788305982.430857:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015386240:0@lo:400:kworker.0 00000100:00100000:3.0:1788305982.430877:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305982.430893:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015386752:0@lo:400:kworker.0 00000100:00100000:3.0:1788305982.430925:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305982.430941:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875174015387264:0@lo:400:kworker.0 00000100:00100000:3.0:1788305982.430962:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305982.430989:0:23464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015385984 00000100:00100000:3.0:1788305982.430994:0:23464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015385984 00000100:00100000:3.0:1788305982.431032:0:23464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015386496 00000100:00100000:3.0:1788305982.431036:0:23464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015386496 00000100:00100000:3.0:1788305982.431051:0:23464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788305982.431060:0:23464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015385984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305982.431113:0:23464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015385984:12345-0@lo:400:kworker.0 Request processed in 52us (7009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305982.431120:0:23464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788305982.431136:0:23464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788305982.431142:0:23464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015386496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305982.431170:0:23464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015386496:12345-0@lo:400:kworker.0 Request processed in 28us (6995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305982.431176:0:23464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788305982.433092:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788305982.433111:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015387648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305982.433168:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305982.433211:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015387008 00000100:00100000:2.0:1788305982.433224:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015387008 00000100:00100000:2.0:1788305982.433268:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015386368 00000100:00100000:2.0:1788305982.433271:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015386368 00000100:00100000:2.0:1788305982.433299:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015386880 00000100:00100000:2.0:1788305982.433302:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015386880 00000100:00100000:2.0:1788305982.433312:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015387392 00000100:00100000:2.0:1788305982.433314:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015387392 00000100:00100000:2.0:1788305982.433326:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015387136 00000100:00100000:2.0:1788305982.433328:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015387136 00000100:00100000:2.0:1788305982.433340:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015387264 00000100:00100000:2.0:1788305982.433343:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015387264 00000100:00100000:2.0:1788305982.433358:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788305982.433367:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015387008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305982.433416:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015387008:12345-0@lo:400:kworker.0 Request processed in 50us (9187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305982.433423:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788305982.433439:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788305982.433445:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015386368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305982.433472:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015386368:12345-0@lo:400:kworker.0 Request processed in 28us (6275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305982.433478:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788305982.433489:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788305982.433494:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015386880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305982.433521:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015386880:12345-0@lo:400:kworker.0 Request processed in 27us (6230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305982.433526:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788305982.433539:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788305982.433544:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015387392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305982.433581:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015387392:12345-0@lo:400:kworker.0 Request processed in 36us (3096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305982.433587:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788305982.433600:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788305982.433606:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015387136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305982.433633:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015387136:12345-0@lo:400:kworker.0 Request processed in 27us (2800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305982.433639:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788305982.433650:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788305982.433656:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875174015387264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305982.433700:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875174015387264:12345-0@lo:400:kworker.0 Request processed in 44us (2736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305982.433719:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788305982.433742:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015386112 00000100:00100000:2.0:1788305982.433746:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015386112 00000100:00100000:2.0:1788305982.433767:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015386624 00000100:00100000:2.0:1788305982.433770:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015386624 00000100:00100000:2.0:1788305982.433781:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015386240 00000100:00100000:2.0:1788305982.433784:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015386240 00000100:00100000:2.0:1788305982.433795:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015386752 00000100:00100000:2.0:1788305982.433798:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015386752 00000100:00100000:2.0:1788305982.433811:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788305982.433818:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015386112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305982.433851:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015386112:12345-0@lo:400:kworker.0 Request processed in 33us (3120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305982.433857:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788305982.433868:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788305982.433879:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015386624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305982.433906:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015386624:12345-0@lo:400:kworker.0 Request processed in 27us (3133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305982.433912:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788305982.433922:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788305982.433928:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015386240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305982.433951:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015386240:12345-0@lo:400:kworker.0 Request processed in 23us (3073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305982.433956:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788305982.433965:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788305982.433971:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d114e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015386752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305982.433994:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d114e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015386752:12345-0@lo:400:kworker.0 Request processed in 23us (3068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305982.434000:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788305982.434142:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1788305982.434159:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015386240:0@lo:400:kworker.0 00000100:00100000:2.0:1788305982.434171:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015386752:0@lo:400:kworker.0 00000100:00100000:2.0:1788305982.434181:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875174015387264:0@lo:400:kworker.0 00000100:00100000:2.0:1788305982.434191:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015386112:0@lo:400:kworker.0 00000100:00100000:2.0:1788305982.434201:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015386624:0@lo:400:kworker.0 00010000:00080000:2.0:1788305982.434212:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889184024e00 x1875174015387136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305982.434223:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015387136:0@lo:400:kworker.0 00000100:00100000:2.0:1788305982.434263:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015387520 00000100:00100000:2.0:1788305982.434268:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015387520 00000100:00100000:2.0:1788305982.434309:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015387648 00000100:00100000:2.0:1788305982.434312:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015387648 00000100:00100000:2.0:1788305982.434323:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788305982.434329:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184025c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015387520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305982.434353:0:24235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788305982.434389:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184025c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015387520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (3777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305982.434395:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788305982.434407:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788305982.434414:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015387648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788305982.434423:0:24235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788305982.434456:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015387648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305982.434461:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788305982.434478:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788305982.434482:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788305982.434484:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788305982.434486:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305982.434509:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015387648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305982.450866:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015387520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305982.450885:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015386368:0@lo:400:kworker.0 00000100:00100000:3.0:1788305982.450897:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015386880:0@lo:400:kworker.0 00010000:00080000:3.0:1788305982.450910:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889184024380 x1875174015387392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305982.450922:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015387392:0@lo:400:kworker.0 00000100:00100000:3.0:1788305982.450933:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015385984:0@lo:400:kworker.0 00000100:00100000:3.0:1788305982.450960:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015386496:0@lo:400:kworker.0 00000100:00100000:3.0:1788305982.450971:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015387008:0@lo:400:kworker.0 00000001:02000400:3.0:1788305982.839404:0:25604:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788305983.194883:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305984.214397:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305984.473013:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305984.473046:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015387776:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305984.473142:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305984.473324:0:23464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015387776 00000100:00100000:0.0:1788305984.473334:0:23464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015387776 00000100:00100000:0.0:1788305984.473401:0:23464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788305984.473412:0:23464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015387776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788305984.473467:0:23464:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788305984.473538:0:23464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015387776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305984.473546:0:23464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788305984.474389:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015387776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305984.480803:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015387904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305984.480979:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305984.481369:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015387904 00000100:00100000:0.0:1788305984.481379:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015387904 00000100:00100000:0.0:1788305984.481520:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788305984.481533:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015387904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305984.481573:0:24235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788305984.481636:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015387904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305984.481643:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788305984.481719:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015387904:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788305984.483163:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305984.635103:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305984.635156:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305984.635213:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305984.635242:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305984.635265:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305984.635315:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305984.635338:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305984.635354:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305984.635377:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305984.635410:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994297216 00000100:00100000:1.0:1788305984.635422:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994297216 00000100:00100000:1.0:1788305984.635490:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994297728 00000100:00100000:1.0:1788305984.635494:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994297728 00000100:00100000:1.0:1788305984.635521:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994297088 00000100:00100000:1.0:1788305984.635524:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994297088 00000100:00100000:1.0:1788305984.635540:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994297600 00000100:00100000:1.0:1788305984.635543:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994297600 00000100:00100000:1.0:1788305984.635561:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 47 00000100:00100000:1.0:1788305984.635573:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+5:2397:x1875173994297216:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305984.635669:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+5:2397:x1875173994297216:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 98us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305984.635677:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 47 00000100:00100000:1.0:1788305984.635705:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 48 00000100:00100000:1.0:1788305984.635721:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c1259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e482d8f-ec3a-4afe-a831-3f7381c98170+5:2397:x1875173994297728:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305984.635746:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c1259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e482d8f-ec3a-4afe-a831-3f7381c98170+5:2397:x1875173994297728:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 26us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305984.635752:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 48 00000100:00100000:1.0:1788305984.635765:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 49 00000100:00100000:1.0:1788305984.635772:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c1259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:2397:x1875173994297088:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305984.635796:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c1259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:2397:x1875173994297088:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 25us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305984.635803:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 49 00000100:00100000:1.0:1788305984.635815:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00100000:1.0:1788305984.635821:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c125aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:2397:x1875173994297600:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305984.635859:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c125aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:2397:x1875173994297600:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 37us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305984.635865:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00100000:1.0:1788305984.635888:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994297472 00000100:00100000:1.0:1788305984.635892:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994297472 00000100:00100000:1.0:1788305984.635912:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994297984 00000100:00100000:1.0:1788305984.635914:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994297984 00000100:00100000:1.0:1788305984.635924:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994297344 00000100:00100000:1.0:1788305984.635926:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994297344 00000100:00100000:1.0:1788305984.635936:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994297856 00000100:00100000:1.0:1788305984.635938:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994297856 00000100:00100000:1.0:1788305984.635949:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:1.0:1788305984.635955:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c1258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+5:2397:x1875173994297472:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305984.635980:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c1258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+5:2397:x1875173994297472:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 25us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305984.635995:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:1.0:1788305984.636006:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:1.0:1788305984.636011:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c125b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:2397:x1875173994297984:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305984.636031:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c125b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:2397:x1875173994297984:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 19us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305984.636036:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:1.0:1788305984.636044:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:1.0:1788305984.636050:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c125a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+5:2397:x1875173994297344:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305984.636067:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c125a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+5:2397:x1875173994297344:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 17us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305984.636073:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:1.0:1788305984.636080:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:1.0:1788305984.636085:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c125b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e482d8f-ec3a-4afe-a831-3f7381c98170+5:2397:x1875173994297856:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305984.636102:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c125b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e482d8f-ec3a-4afe-a831-3f7381c98170+5:2397:x1875173994297856:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 16us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305984.636107:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00080000:1.0:1788305984.636125:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788305984.636129:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788305984.636132:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788305984.636134:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788305984.637755:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994296960 00000100:00100000:3.0:1788305984.637773:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994296960 00000100:00100000:3.0:1788305984.637856:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 148 00000100:00100000:3.0:1788305984.637867:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+13:2397:x1875173994296960:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305984.637952:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+13:2397:x1875173994296960:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 87us (2863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305984.637960:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 148 00000100:00100000:3.0:1788305984.981867:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788305984.981897:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015388032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305984.981989:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305984.982045:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015388032 00000100:00100000:3.0:1788305984.982054:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015388032 00000100:00100000:3.0:1788305984.982112:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788305984.982122:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015388032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788305984.982171:0:22726:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788305984.982220:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015388032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305984.982228:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788305984.982333:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015388032:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1788305984.995349:0:25048:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8e482d8f-ec3a-4afe-a831-3f7381c98170 00010000:00010000:0.0:1788305985.237656:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305985.493482:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305985.493528:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015388160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305985.493628:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305985.493704:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015388160 00000100:00100000:3.0:1788305985.493713:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015388160 00000100:00100000:3.0:1788305985.493793:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788305985.493806:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015388160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788305985.493837:0:24235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788305985.493890:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015388160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305985.493898:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788305985.493922:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305985.493966:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015388160:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1788305985.750920:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788305986.262455:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305987.289113:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788305987.373705:0:25752:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1fb6e070 20000000:00000080:2.0:1788305987.373732:0:25752:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8891c1251000 uarg=0000000000000000 20000000:01000000:2.0:1788305987.373993:0:25752:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788305987.374002:0:25752:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788305987.374009:0:25752:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788305987.375740:0:25753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1788305987.376170:0:25752:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788305987.394201:0:25752:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788305987.394586:0:25752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889181682e00/0x4a426866e60554bd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.394612:0:25752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88919d7dec00/0x4a426866e605511a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6055113 expref: 23 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.394621:0:25752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891a523ae00/0x4a426866e6055128 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6055121 expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.394640:0:25752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891bb3eb200/0x4a426866e6055167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6055160 expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.394647:0:25752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88919d7de000/0x4a426866e60552e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60552e1 expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.394668:0:25752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889183565000/0x4a426866e605544d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe089b9 expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.394697:0:25752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891903f8a00/0x4a426866e605548c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a29 expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.394706:0:25752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889181682e00/0x4a426866e60554bd lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.394787:0:25752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891903f8a00/0x4a426866e605548c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a29 expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.394818:0:25752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8891903f8a00/0x4a426866e605548c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a29 expref: 12 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305987.394837:0:25752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d115c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875174015388288:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305987.394969:0:25752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889183565000/0x4a426866e605544d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe089b9 expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.394977:0:25752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889183565000/0x4a426866e605544d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe089b9 expref: 12 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305987.394986:0:25752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d116300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875174015388416:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305987.395017:0:25752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88919d7de000/0x4a426866e60552e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60552e1 expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.395026:0:25752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88919d7de000/0x4a426866e60552e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60552e1 expref: 23 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305987.395036:0:25752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d116a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875174015388544:0@lo:104: 00000100:00100000:3.0:1788305987.395089:0:25752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788305987.395206:0:25752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891bb3eb200/0x4a426866e6055167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e6055160 expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.395229:0:25752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8891bb3eb200/0x4a426866e6055167 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e6055160 expref: 23 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305987.395238:0:25752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d115180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875174015388672:0@lo:104: 00000100:00100000:3.0:1788305987.395263:0:25752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788305987.398040:0:25752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891a523ae00/0x4a426866e6055128 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e6055121 expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.398065:0:25752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8891a523ae00/0x4a426866e6055128 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e6055121 expref: 23 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305987.398083:0:25752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d115f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875174015388800:0@lo:104: 00000100:00100000:3.0:1788305987.398154:0:25752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305987.398737:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015388544 00000100:00100000:2.0:1788305987.398749:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015388544 00000100:00100000:2.0:1788305987.399750:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015388672 00000100:00100000:2.0:1788305987.400052:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015388672 00000100:00100000:2.0:1788305987.400092:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788305987.400102:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d117800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4402ecd-e8a2-4271-82d7-771a7bb97982+4:25752:x1875174015388544:12345-0@lo:104: 00010000:00010000:2.0:1788305987.400124:0:22705:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889181683600/0x4a426866e60552e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60552e8 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305987.400536:0:22705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788305987.400545:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d117800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4402ecd-e8a2-4271-82d7-771a7bb97982+4:25752:x1875174015388544:12345-0@lo:104: Request processed in 444us (5457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305987.400553:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788305987.400590:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788305987.400598:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d115500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4402ecd-e8a2-4271-82d7-771a7bb97982+3:25752:x1875174015388672:12345-0@lo:104: 00010000:00010000:2.0:1788305987.400608:0:22705:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889181683400/0x4a426866e6055160 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6055167 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.400975:0:25752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88919d7dec00/0x4a426866e605511a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e6055113 expref: 23 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.400992:0:25752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88919d7dec00/0x4a426866e605511a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e6055113 expref: 23 pid: 22716 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305987.401009:0:25752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d117100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875174015388928:0@lo:104: 00000100:00100000:3.0:1788305987.401053:0:25752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305987.401066:0:25752:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b8f89d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788305987.401095:0:25752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d116a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875174015388544:0@lo:104: 00000100:00100000:3.0:1788305987.401104:0:25752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d115180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875174015388672:0@lo:104: 00000100:00100000:0.0:1788305987.401742:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015388800 00000100:00100000:0.0:1788305987.401751:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015388800 00000100:00100000:0.0:1788305987.401957:0:22706:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788305987.401968:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1788305987.402691:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788305987.402702:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181683600/0x4a426866e60552e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60552e8 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305987.402738:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181683600 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:1.0:1788305987.402743:0:22710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181683600/0x4a426866e60552e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60552e8 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305987.402754:0:22710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181683600/0x4a426866e60552e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60552e8 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305987.402998:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015388928 00000100:00100000:3.0:1788305987.403006:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015388928 10000000:00010000:1.0:1788305987.403081:0:22710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181683600/0x4a426866e60552e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60552e8 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305987.403087:0:22710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788305987.403142:0:22710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181683600/0x4a426866e60552e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60552e8 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305987.403149:0:22710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305987.403179:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181683600/0x4a426866e60552e1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60552e8 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305987.403186:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181683600/0x4a426866e60552e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60552e8 expref: -99 pid: 25047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305987.403203:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305987.403207:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181683400/0x4a426866e6055160 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6055167 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305987.403370:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181683400 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:1.0:1788305987.403374:0:22710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181683400/0x4a426866e6055160 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6055167 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305987.403395:0:22710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181683400/0x4a426866e6055160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6055167 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305987.403401:0:22710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181683400/0x4a426866e6055160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6055167 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305987.403407:0:22710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788305987.403424:0:22710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181683400/0x4a426866e6055160 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6055167 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305987.403431:0:22710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305987.403448:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181683400/0x4a426866e6055160 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6055167 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305987.403454:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181683400/0x4a426866e6055160 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6055167 expref: -99 pid: 24226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305987.403465:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305987.403467:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305987.403469:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305987.403751:0:22705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788305987.403784:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d115500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4402ecd-e8a2-4271-82d7-771a7bb97982+5:25752:x1875174015388672:12345-0@lo:104: Request processed in 3173us (8507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305987.403816:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788305987.403861:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788305987.403878:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d114000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4402ecd-e8a2-4271-82d7-771a7bb97982+4:25752:x1875174015388800:12345-0@lo:104: 00010000:00010000:2.0:1788305987.403891:0:22705:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff88919d7de600/0x4a426866e6055121 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6055128 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305987.404253:0:25754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788305987.404263:0:25754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d114700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f4402ecd-e8a2-4271-82d7-771a7bb97982+4:25752:x1875174015388928:12345-0@lo:104: 00010000:00010000:0.0:1788305987.404272:0:25754:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6055113 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e605511a expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305987.404577:0:25752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d115c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875174015388288:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788305987.405040:0:25752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d116300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875174015388416:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788305987.405106:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305987.405295:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00010000:00010000:2.0:1788305987.405387:0:22705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788305987.405396:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d114000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4402ecd-e8a2-4271-82d7-771a7bb97982+4:25752:x1875174015388800:12345-0@lo:104: Request processed in 1526us (7241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305987.405406:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788305987.405447:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305987.405467:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891c1259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4402ecd-e8a2-4271-82d7-771a7bb97982:3649:1875174015389056:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788305987.405514:0:22711:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305987.405521:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff88919d7de600/0x4a426866e6055121 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6055128 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305987.405530:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7de600 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305987.405535:0:22711:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff88919d7de600/0x4a426866e6055121 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6055128 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305987.405545:0:22711:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff88919d7de600/0x4a426866e6055121 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6055128 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305987.405553:0:22711:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff88919d7de600/0x4a426866e6055121 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6055128 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305987.405570:0:22711:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788305987.405613:0:22711:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff88919d7de600/0x4a426866e6055121 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6055128 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305987.405631:0:22711:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305987.405647:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff88919d7de600/0x4a426866e6055121 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6055128 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305987.405655:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff88919d7de600/0x4a426866e6055121 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6055128 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305987.405682:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305987.405684:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305987.405685:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305987.405693:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305987.406201:0:25754:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788305987.406218:0:25754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d114700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f4402ecd-e8a2-4271-82d7-771a7bb97982+3:25752:x1875174015388928:12345-0@lo:104: Request processed in 1948us (5156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305987.406228:0:25754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788305987.406652:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305987.406670:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6055113 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e605511a expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305987.406680:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea200 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305987.406683:0:22710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6055113 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e605511a expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305987.406691:0:22710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6055113 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e605511a expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305987.406698:0:22710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6055113 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e605511a expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305987.406704:0:22710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788305987.406749:0:22710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6055113 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605511a expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305987.406766:0:22710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305987.407071:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6055113 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605511a expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305987.407078:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6055113 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605511a expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305987.407098:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305987.407100:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305987.407102:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305987.407115:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788305987.407132:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4402ecd-e8a2-4271-82d7-771a7bb97982:3650:1875174015389440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305987.407397:0:25752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d115f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875174015388800:0@lo:104: 00000100:00100000:2.0:1788305987.407408:0:25752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d117100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25752:1875174015388928:0@lo:104: 00010000:00010000:2.0:1788305987.407445:0:25752:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889181682e00/0x4a426866e60554bd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305987.407519:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891c1259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4402ecd-e8a2-4271-82d7-771a7bb97982:3647:1875174015389184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305987.407727:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4402ecd-e8a2-4271-82d7-771a7bb97982:3648:1875174015389312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305987.407987:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305987.408058:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994298112 00000100:00100000:3.0:1788305987.408067:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994298112 00010000:00010000:3.0:1788305987.408111:0:22708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891903f8a00/0x4a426866e605548c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a29 expref: 13 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305987.408142:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994298240 00000100:00100000:3.0:1788305987.408146:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994298240 00010000:00010000:3.0:1788305987.408158:0:22708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889183565000/0x4a426866e605544d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe089b9 expref: 14 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305987.408173:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:3.0:1788305987.408183:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c1259f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f8ba539-95ac-42db-9f6d-9f19c8062908+14:2395:x1875173994298112:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305987.408200:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305987.408206:0:22708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891903f8a00/0x4a426866e605548c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a29 expref: 14 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305987.408313:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788305987.408418:0:22708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891903f8a00/0x4a426866e605548c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a29 expref: 14 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.408438:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891903f8a00/0x4a426866e605548c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a29 expref: 14 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.408455:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305987.408631:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c1259f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f8ba539-95ac-42db-9f6d-9f19c8062908+13:2395:x1875173994298112:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 449us (3526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305987.408641:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:3.0:1788305987.408670:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015389312 00000100:00100000:3.0:1788305987.408674:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015389312 00010000:00010000:3.0:1788305987.408705:0:22708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891a523ae00/0x4a426866e6055128 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6055121 expref: 24 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305987.408721:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:3.0:1788305987.408728:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c1258000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f8ba539-95ac-42db-9f6d-9f19c8062908+12:2395:x1875173994298240:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305987.408737:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305987.408741:0:22708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889183565000/0x4a426866e605544d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe089b9 expref: 12 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.408750:0:22708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889183565000/0x4a426866e605544d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe089b9 expref: 12 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.408778:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889183565000/0x4a426866e605544d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe089b9 expref: 12 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.409000:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305987.409026:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c1258000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3f8ba539-95ac-42db-9f6d-9f19c8062908+11:2395:x1875173994298240:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 299us (3754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305987.409034:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:3.0:1788305987.409049:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788305987.409054:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c125b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:3648:x1875174015389312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788305987.409064:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305987.409068:0:22708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891a523ae00/0x4a426866e6055128 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6055121 expref: 24 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.409077:0:22708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891a523ae00/0x4a426866e6055128 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e6055121 expref: 24 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.409089:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891a523ae00/0x4a426866e6055128 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e6055121 expref: 24 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.409105:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305987.409152:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c125b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+23:3648:x1875174015389312:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305987.409158:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788305987.409205:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4402ecd-e8a2-4271-82d7-771a7bb97982:3648:1875174015389312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788305987.409638:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015389184 00000100:00100000:3.0:1788305987.409644:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015389184 00010000:00010000:3.0:1788305987.409674:0:22708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891bb3eb200/0x4a426866e6055167 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6055160 expref: 23 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305987.409702:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788305987.409710:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+23:3647:x1875174015389184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788305987.409719:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305987.409723:0:22708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891bb3eb200/0x4a426866e6055167 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6055160 expref: 23 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.409732:0:22708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891bb3eb200/0x4a426866e6055167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e6055160 expref: 23 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.409745:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3eb200/0x4a426866e6055167 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e6055160 expref: 23 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305987.409761:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305987.410007:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4402ecd-e8a2-4271-82d7-771a7bb97982+22:3647:x1875174015389184:12345-0@lo:103:ldlm_bl.0 Request processed in 298us (2020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305987.410014:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788305987.410075:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891c1259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4402ecd-e8a2-4271-82d7-771a7bb97982:3647:1875174015389184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305987.411454:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305987.413723:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305987.422778:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015389056 00000100:00100000:2.0:1788305987.423763:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015389056 00010000:00010000:0.0:1788305987.424092:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88919d7de000/0x4a426866e60552e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60552e1 expref: 22 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305987.424152:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015389440 00000100:00100000:0.0:1788305987.424157:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015389440 00010000:00010000:0.0:1788305987.424171:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88919d7dec00/0x4a426866e605511a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6055113 expref: 23 pid: 22716 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305987.424188:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788305987.424198:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4402ecd-e8a2-4271-82d7-771a7bb97982+23:3649:x1875174015389056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305987.424250:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305987.424257:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88919d7de000/0x4a426866e60552e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60552e1 expref: 23 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305987.424272:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88919d7de000/0x4a426866e60552e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60552e1 expref: 23 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305987.424319:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88919d7de000/0x4a426866e60552e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60552e1 expref: 23 pid: 22714 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305987.424341:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305987.424456:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4402ecd-e8a2-4271-82d7-771a7bb97982+22:3649:x1875174015389056:12345-0@lo:103:ldlm_bl.0 Request processed in 258us (13008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305987.424464:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788305987.424491:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788305987.424497:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb360450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:3650:x1875174015389440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305987.424506:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305987.424510:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88919d7dec00/0x4a426866e605511a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6055113 expref: 21 pid: 22716 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305987.424520:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88919d7dec00/0x4a426866e605511a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e6055113 expref: 21 pid: 22716 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305987.424530:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88919d7dec00/0x4a426866e605511a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e6055113 expref: 21 pid: 22716 timeout: 917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305987.424542:0:22709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889181682e00/0x4a426866e60554bd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305987.424552:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181682e00/0x4a426866e60554bd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305987.424590:0:22709:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889181682e00/0x4a426866e60554bd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305987.424598:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889181682e00/0x4a426866e60554bd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305987.424605:0:22709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889181682e00/0x4a426866e60554bd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305987.424613:0:22709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889181682e00/0x4a426866e60554bd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305987.424621:0:22709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181682e00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305987.424626:0:22709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889181682e00/0x4a426866e60554bd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305987.424635:0:22709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889181682e00/0x4a426866e60554bd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305987.424653:0:22709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889181682e00/0x4a426866e60554bd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305987.424673:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305987.424705:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb360450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4402ecd-e8a2-4271-82d7-771a7bb97982+20:3650:x1875174015389440:12345-0@lo:103:ldlm_bl.0 Request processed in 208us (10994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305987.424711:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788305987.425179:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4402ecd-e8a2-4271-82d7-771a7bb97982:3650:1875174015389440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305987.425243:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891c1259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4402ecd-e8a2-4271-82d7-771a7bb97982:3649:1875174015389056:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788305987.427076:0:25752:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889181682e00/0x4a426866e60554bd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305987.427097:0:25752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889181682e00/0x4a426866e60554bd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305987.427105:0:25752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181682e00/0x4a426866e60554bd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305987.542854:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015389696:0@lo:400:kworker.0 00000100:00100000:3.0:1788305987.542965:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305987.543008:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015390208:0@lo:400:kworker.0 00000100:00100000:3.0:1788305987.543032:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305987.543052:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908202fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015390720:0@lo:400:kworker.0 00000100:00100000:3.0:1788305987.543078:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305987.543106:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788305987.543112:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015389824:0@lo:400:kworker.0 00000100:00100000:3.0:1788305987.543136:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305987.543153:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015390336:0@lo:400:kworker.0 00000100:00100000:3.0:1788305987.543175:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305987.543190:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908202c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015390848:0@lo:400:kworker.0 00000100:00100000:3.0:1788305987.543210:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305987.543253:0:24697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015389696 00000100:00100000:3.0:1788305987.543263:0:24697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015389696 00000100:00100000:1.0:1788305987.543648:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015389568:0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.543699:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305987.543723:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015390080:0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.543746:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305987.543767:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908202c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015390592:0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.543786:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305987.543800:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891c1259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015391104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305987.543823:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305987.543844:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788305987.543850:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015389952:0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.543872:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305987.543889:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d116a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015390464:0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.543909:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305987.543919:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908202e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015390976:0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.543940:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305987.543970:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015390208 00000100:00100000:1.0:1788305987.543975:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015390208 00000100:00100000:1.0:1788305987.544005:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015389824 00000100:00100000:1.0:1788305987.544009:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015389824 00000100:00100000:1.0:1788305987.544022:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015390336 00000100:00100000:1.0:1788305987.544024:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015390336 00000100:00100000:1.0:1788305987.544042:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788305987.544053:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015389696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.544115:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015389696:12345-0@lo:400:kworker.0 Request processed in 64us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305987.544123:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788305987.544158:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788305987.544165:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015390208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.544192:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015390208:12345-0@lo:400:kworker.0 Request processed in 28us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305987.544199:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788305987.544210:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788305987.544215:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015389824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.544237:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015389824:12345-0@lo:400:kworker.0 Request processed in 22us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305987.544243:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788305987.544252:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788305987.544257:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015390336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.544311:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015390336:12345-0@lo:400:kworker.0 Request processed in 54us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305987.544317:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788305987.544335:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015390720 00000100:00100000:1.0:1788305987.544338:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015390720 00000100:00100000:1.0:1788305987.544550:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015390848 00000100:00100000:1.0:1788305987.544555:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015390848 00000100:00100000:1.0:1788305987.544570:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015390592 00000100:00100000:1.0:1788305987.544573:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015390592 00000100:00100000:1.0:1788305987.544583:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015389952 00000100:00100000:1.0:1788305987.544585:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015389952 00000100:00100000:1.0:1788305987.544595:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015390464 00000100:00100000:1.0:1788305987.544596:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015390464 00000100:00100000:1.0:1788305987.544606:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015390976 00000100:00100000:1.0:1788305987.544608:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015390976 00000100:00100000:1.0:1788305987.544620:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788305987.544627:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015390720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.544683:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015390720:12345-0@lo:400:kworker.0 Request processed in 56us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305987.544689:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788305987.544700:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788305987.544705:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015390848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.544730:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015390848:12345-0@lo:400:kworker.0 Request processed in 26us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305987.544735:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788305987.544745:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788305987.544750:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c1258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015390592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.544781:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c1258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015390592:12345-0@lo:400:kworker.0 Request processed in 30us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305987.544786:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788305987.544796:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788305987.544801:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c125ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015389952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.544827:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c125ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015389952:12345-0@lo:400:kworker.0 Request processed in 26us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305987.544833:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788305987.544843:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788305987.544848:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c1258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015390464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.544872:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c1258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015390464:12345-0@lo:400:kworker.0 Request processed in 25us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305987.544878:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788305987.544889:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788305987.544895:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c1259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015390976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.544931:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c1259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015390976:12345-0@lo:400:kworker.0 Request processed in 37us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305987.544938:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788305987.544964:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015389568 00000100:00100000:1.0:1788305987.544968:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015389568 00000100:00100000:1.0:1788305987.544996:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015390080 00000100:00100000:1.0:1788305987.544999:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015390080 00000100:00100000:1.0:1788305987.545013:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788305987.545019:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c1258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015389568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.545064:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c1258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015389568:12345-0@lo:400:kworker.0 Request processed in 45us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305987.545070:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788305987.545082:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788305987.545088:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c125bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015390080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.545113:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c125bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015390080:12345-0@lo:400:kworker.0 Request processed in 26us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305987.545120:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788305987.545163:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015391104 00000100:00100000:1.0:1788305987.545168:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015391104 00000100:00100000:1.0:1788305987.545196:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788305987.545202:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c125a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015391104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788305987.545229:0:24235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788305987.545266:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c125a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015391104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (1442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305987.545272:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788305987.545533:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305987.545540:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788305987.545544:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305987.545547:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305987.547756:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015391232:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305987.547852:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305987.547933:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015389824:0@lo:400:kworker.0 00000100:00100000:0.0:1788305987.547973:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015390336:0@lo:400:kworker.0 00000100:00100000:0.0:1788305987.547993:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908202c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015390848:0@lo:400:kworker.0 00000100:00100000:0.0:1788305987.548008:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015389696:0@lo:400:kworker.0 00000100:00100000:0.0:1788305987.548033:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015390208:0@lo:400:kworker.0 00010000:00080000:0.0:1788305987.548051:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88908202fb80 x1875174015390720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788306003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305987.548062:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908202fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015390720:0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.551616:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015389952:0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.551714:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d116a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015390464:0@lo:400:kworker.0 00010000:00080000:1.0:1788305987.551737:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88908202e680 x1875174015390976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788306003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305987.551750:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908202e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015390976:0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.551766:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015389568:0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.551782:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015390080:0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.551798:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908202c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015390592:0@lo:400:kworker.0 00000100:00100000:1.0:1788305987.551825:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891c1259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015391104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305987.551891:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015391232 00000100:00100000:1.0:1788305987.551899:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015391232 00000100:00100000:1.0:1788305987.551968:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788305987.551980:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015391232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788305987.552009:0:24235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788305987.552111:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015391232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (4259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305987.552120:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788305987.552181:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015391232:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788305988.309588:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305988.976196:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305988.984742:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994298368 00000100:00100000:2.0:1788305988.984768:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994298368 00000100:00100000:2.0:1788305988.984875:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 149 00000100:00100000:2.0:1788305988.984890:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8ba539-95ac-42db-9f6d-9f19c8062908+11:18136:x1875173994298368:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305988.984913:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305988.984941:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889183565000/0x4a426866e60554c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08a61 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305988.984978:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183565000/0x4a426866e60554c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a61 expref: 12 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305988.984991:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889183565000/0x4a426866e60554c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a61 expref: 12 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305988.985003:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183565000, rc 0) 00000100:00100000:2.0:1788305988.985096:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8ba539-95ac-42db-9f6d-9f19c8062908+12:18136:x1875173994298368:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 Request processed in 209us (8917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305988.985104:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 149 00000100:00100000:1.0:1788305988.993785:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305988.993941:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994298496 00000100:00100000:0.0:1788305988.993959:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994298496 00000100:00100000:0.0:1788305988.994048:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 150 00000100:00100000:0.0:1788305988.994060:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+12:18136:x1875173994298496:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305988.994388:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+12:18136:x1875173994298496:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 Request processed in 328us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305988.994397:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 150 00000100:00100000:1.0:1788305989.008776:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305989.009204:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994298624 00000100:00100000:3.0:1788305989.009220:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994298624 00000100:00100000:3.0:1788305989.009329:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 151 00000100:00100000:3.0:1788305989.009342:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+12:18136:x1875173994298624:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305989.009560:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+12:18136:x1875173994298624:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 Request processed in 220us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305989.009570:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 151 00000100:00100000:1.0:1788305989.020805:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305989.021027:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994298752 00000100:00100000:2.0:1788305989.021043:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994298752 00000100:00100000:2.0:1788305989.021115:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 152 00000100:00100000:2.0:1788305989.021128:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8ba539-95ac-42db-9f6d-9f19c8062908+12:18136:x1875173994298752:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305989.021166:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305989.021190:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889183564a00/0x4a426866e60554cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08a68 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.021231:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183564a00/0x4a426866e60554cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a68 expref: 13 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.021316:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889183564a00/0x4a426866e60554cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a68 expref: 13 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.021330:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183564a00, rc 0) 00000100:00100000:2.0:1788305989.021426:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8ba539-95ac-42db-9f6d-9f19c8062908+13:18136:x1875173994298752:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 Request processed in 300us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305989.021434:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 152 00000100:00100000:1.0:1788305989.051957:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305989.052137:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994298880 00000100:00100000:0.0:1788305989.052161:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994298880 00000100:00100000:0.0:1788305989.052237:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 153 00000100:00100000:0.0:1788305989.052250:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+13:18136:x1875173994298880:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305989.052497:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+13:18136:x1875173994298880:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 Request processed in 249us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305989.052507:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 153 00000100:00100000:1.0:1788305989.063476:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305989.063629:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994299008 00000100:00100000:3.0:1788305989.063659:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994299008 00000100:00100000:3.0:1788305989.063751:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 154 00000100:00100000:3.0:1788305989.063764:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+13:18136:x1875173994299008:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305989.063954:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3f8ba539-95ac-42db-9f6d-9f19c8062908+13:18136:x1875173994299008:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 Request processed in 191us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305989.063963:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 154 10000000:01000000:0.0:1788305989.333455:0:22720:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788305989.333469:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88908259c800 from 13 10000000:01000000:0.0:1788305989.333504:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788305989.333572:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f8200/0x4a426866e60554d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.333586:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891903f8200/0x4a426866e60554d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.333601:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891903f8200/0x4a426866e60554d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305989.333634:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015391360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788305989.333769:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305989.333837:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af32cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305989.334373:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015391360 00000100:00100000:2.0:1788305989.334385:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015391360 00000100:00100000:2.0:1788305989.334458:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788305989.334472:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083098850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+20:22720:x1875174015391360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305989.334493:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305989.334513:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889183565200/0x4a426866e60554d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60554d2 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.334545:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183565200/0x4a426866e60554d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60554d2 expref: 21 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.334558:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889183565200/0x4a426866e60554d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60554d2 expref: 21 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.334569:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183565200, rc 0) 00000100:00100000:2.0:1788305989.334638:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083098850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:22720:x1875174015391360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305989.334932:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00010000:00010000:3.0:1788305989.335087:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305989.335188:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015391360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305989.335210:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891903f8200/0x4a426866e60554d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60554d9 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.335221:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891903f8200/0x4a426866e60554d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60554d9 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305989.335352:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015391488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305989.337635:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305989.337828:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af32cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305989.337949:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015391488 00000100:00100000:1.0:1788305989.337961:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015391488 00000100:00100000:1.0:1788305989.338036:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788305989.338048:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083098450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:22720:x1875174015391488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305989.338245:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083098450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:22720:x1875174015391488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 199us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305989.338255:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788305989.338878:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015391488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305989.338964:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015391616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305989.339043:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305989.339091:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af32cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305989.339589:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015391616 00000100:00100000:2.0:1788305989.339598:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015391616 00000100:00100000:2.0:1788305989.339815:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788305989.339826:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083098050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:22720:x1875174015391616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305989.340917:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083098050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:22720:x1875174015391616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1086us (1866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305989.340930:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788305989.350019:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015391616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788305989.353266:0:25766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788305989.353985:0:22720:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788305989.354031:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788305989.354048:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f8200/0x4a426866e60554d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60554d9 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.354063:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891903f8200/0x4a426866e60554d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60554d9 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305989.354076:0:22720:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788305989.354079:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889182aee000 from 13 10000000:01000000:0.0:1788305989.354082:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788305989.354136:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9200/0x4a426866e60554e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.354145:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891903f9200/0x4a426866e60554e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.354158:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891903f9200/0x4a426866e60554e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305989.354191:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015391744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788305989.354312:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305989.354384:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825ba780 going to sleep for 11 seconds 00000100:00100000:1.0:1788305989.354631:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015391744 00000100:00100000:1.0:1788305989.354651:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015391744 00000100:00100000:1.0:1788305989.354728:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788305989.354739:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083099050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+21:22720:x1875174015391744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305989.354756:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305989.354771:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88919d7df600/0x4a426866e60554e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60554e0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.354799:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88919d7df600/0x4a426866e60554e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60554e0 expref: 22 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.354810:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88919d7df600/0x4a426866e60554e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60554e0 expref: 22 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.354820:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88919d7df600, rc 0) 00000100:00100000:1.0:1788305989.354890:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083099050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+22:22720:x1875174015391744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305989.354898:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788305989.355207:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015391744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305989.355227:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891903f9200/0x4a426866e60554e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60554e7 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.355236:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891903f9200/0x4a426866e60554e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60554e7 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305989.355375:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015391872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305989.355406:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305989.355435:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825ba780 going to sleep for 11 seconds 00000100:00100000:2.0:1788305989.357927:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015391872 00000100:00100000:2.0:1788305989.357949:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015391872 00000100:00100000:2.0:1788305989.358051:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788305989.358065:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908309bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+22:22720:x1875174015391872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305989.358353:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908309bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+22:22720:x1875174015391872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (2945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305989.358362:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788305989.358729:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015391872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305989.358805:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015392000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305989.358887:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305989.358950:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825ba780 going to sleep for 11 seconds 00000100:00100000:2.0:1788305989.359506:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015392000 00000100:00100000:2.0:1788305989.359515:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015392000 00000100:00100000:2.0:1788305989.359570:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788305989.359580:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908309b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+22:22720:x1875174015392000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305989.360857:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908309b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+22:22720:x1875174015392000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1266us (1959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305989.360874:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788305989.367941:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015392000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788305989.369508:0:25767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788305989.369858:0:22720:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788305989.369907:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788305989.369923:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9200/0x4a426866e60554e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60554e7 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.369937:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891903f9200/0x4a426866e60554e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60554e7 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305989.369950:0:22720:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788305989.369954:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8891bfab2000 from 13 10000000:01000000:0.0:1788305989.369957:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788305989.370009:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e60554ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.370018:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e60554ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.370030:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e60554ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305989.370084:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015392128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788305989.370176:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305989.370248:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825ba780 going to sleep for 11 seconds 00000100:00100000:1.0:1788305989.370358:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015392128 00000100:00100000:1.0:1788305989.370368:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015392128 00000100:00100000:1.0:1788305989.370436:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788305989.370449:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083099450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+22:22720:x1875174015392128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305989.370474:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305989.370491:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88919d7dec00/0x4a426866e60554f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60554ee expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.370523:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88919d7dec00/0x4a426866e60554f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60554ee expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.370536:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88919d7dec00/0x4a426866e60554f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60554ee expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.370548:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88919d7dec00, rc 0) 00000100:00100000:1.0:1788305989.370608:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083099450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+23:22720:x1875174015392128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305989.370617:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788305989.370859:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015392128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305989.370879:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e60554ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60554f5 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.370889:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e60554ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60554f5 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305989.370972:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015392256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305989.371002:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305989.371037:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825ba780 going to sleep for 11 seconds 00000100:00100000:1.0:1788305989.371097:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015392256 00000100:00100000:1.0:1788305989.371104:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015392256 00000100:00100000:1.0:1788305989.371139:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788305989.371147:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908309a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+23:22720:x1875174015392256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305989.371324:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908309a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+23:22720:x1875174015392256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 176us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305989.371332:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788305989.371854:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e67800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015392256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305989.371904:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908202e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015392384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305989.371962:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305989.371994:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff889182f616c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305989.373148:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015392384 00000100:00100000:2.0:1788305989.373165:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015392384 00000100:00100000:2.0:1788305989.373239:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788305989.373250:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083099c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+23:22720:x1875174015392384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305989.374028:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083099c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+23:22720:x1875174015392384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 775us (2061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305989.374038:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788305989.379991:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908202e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015392384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788305989.383575:0:25768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788305989.386549:0:22720:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788305989.386616:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788305989.386633:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e60554ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60554f5 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.386660:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e60554ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60554f5 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305989.386843:0:22720:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788305989.386848:0:22720:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8891bbb3a800 from 13 10000000:01000000:2.0:1788305989.386851:0:22720:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788305989.386923:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e60554fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.386933:0:22720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e60554fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.386947:0:22720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e60554fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305989.386985:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015392512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788305989.387087:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305989.387190:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891baf659c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305989.403159:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015392512 00000100:00100000:0.0:1788305989.403187:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015392512 00000100:00100000:1.0:1788305989.403421:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788305989.403435:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908309b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+23:22720:x1875174015392512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305989.403462:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305989.403490:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88919d7de000/0x4a426866e6055503 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60554fc expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.403530:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88919d7de000/0x4a426866e6055503 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60554fc expref: 24 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.403564:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88919d7de000/0x4a426866e6055503 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60554fc expref: 24 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.403575:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88919d7de000, rc 0) 00000100:00100000:1.0:1788305989.403717:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908309b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:22720:x1875174015392512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 283us (16629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305989.403725:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788305989.404685:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015392512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305989.404719:0:22720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e60554fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055503 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.404733:0:22720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e60554fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6055503 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305989.404847:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015392640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305989.404912:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305989.404972:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825ba600 going to sleep for 11 seconds 00000100:00100000:1.0:1788305989.405255:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015392640 00000100:00100000:1.0:1788305989.405264:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015392640 00000100:00100000:1.0:1788305989.405360:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788305989.405382:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908309a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:22720:x1875174015392640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305989.405548:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908309a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:22720:x1875174015392640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305989.405557:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788305989.405952:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015392640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305989.406002:0:22720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015392768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305989.406061:0:22720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305989.406098:0:22720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825ba600 going to sleep for 11 seconds 00000100:00100000:2.0:1788305989.406149:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015392768 00000100:00100000:2.0:1788305989.406155:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015392768 00000100:00100000:2.0:1788305989.406186:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788305989.406195:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083099850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:22720:x1875174015392768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305989.406321:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083099850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:22720:x1875174015392768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305989.406330:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788305989.407615:0:22720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4402ecd-e8a2-4271-82d7-771a7bb97982:22720:1875174015392768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788305989.421635:0:25769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788305989.422218:0:22720:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788305989.422262:0:22720:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788305989.422312:0:22720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e60554fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055503 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305989.422328:0:22720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e60554fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6055503 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305989.589786:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015392896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305989.589895:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305989.590291:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015392896 00000100:00100000:1.0:1788305989.590301:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015392896 00000100:00100000:1.0:1788305989.590379:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788305989.590393:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015392896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305989.590443:0:24235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788305989.590529:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908202e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015393024:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305989.590568:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788305989.591973:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305989.592087:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015393024 00000100:00100000:3.0:1788305989.592099:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015393024 00000100:00100000:3.0:1788305989.592177:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788305989.592189:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015393024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788305989.592235:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788305989.592362:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015393024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 175us (1792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305989.592369:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788305989.597937:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908202e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015393024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788305989.601592:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015392896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11185us (11680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305989.601613:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788305989.604662:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305989.604820:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994299136 00000100:00100000:2.0:1788305989.604833:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994299136 00000100:00100000:2.0:1788305989.604925:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00100000:2.0:1788305989.604939:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c1259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:18759:x1875173994299136:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305989.604969:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305989.605003:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e605550a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08a6f expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605096:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055511 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605113:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055511 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605128:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055511 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605152:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e6055518 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605159:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e6055518 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605166:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e6055518 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605323:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565800/0x4a426866e605551f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605332:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183565800/0x4a426866e605551f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605339:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183565800/0x4a426866e605551f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305989.605380:0:22723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788305989.605384:0:22723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788305989.605443:0:22723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889183565800/0x4a426866e605551f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605457:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055511 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605464:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055511 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605471:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055511 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605479:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183565c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305989.605484:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055511 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605493:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055511 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605507:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88918c769b00) 00010000:00010000:2.0:1788305989.605517:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305989.605523:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055511 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605529:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055511 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605547:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e6055518 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605552:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e6055518 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605558:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e6055518 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605563:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183565a00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305989.605566:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e6055518 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605572:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e6055518 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605579:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8891c20f9500) 00010000:00010000:2.0:1788305989.605581:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305989.605584:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e6055518 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605590:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e6055518 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605626:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e605550a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a6f expref: 8 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605665:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565800/0x4a426866e605551f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a6f expref: 7 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.605672:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8891c20f9200) 00010000:00010000:2.0:1788305989.605682:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305989.605685:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183565800, rc 0) 00000100:00100000:2.0:1788305989.605769:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c1259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+7:18759:x1875173994299136:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 832us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305989.605777:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00080000:3.0:1788305989.606057:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305989.610504:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305989.610919:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994299264 00000100:00100000:3.0:1788305989.610933:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994299264 00000100:00100000:3.0:1788305989.611010:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:3.0:1788305989.611022:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c1258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+7:18759:x1875173994299264:12345-192.168.202.55@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788305989.611130:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c1258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+7:18759:x1875173994299264:12345-192.168.202.55@tcp:900:lhsmtool_posix.0 Request processed in 111us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305989.611139:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:0.0:1788305989.612038:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015392896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305989.624136:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305989.626096:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994299520 00000100:00100000:2.0:1788305989.626118:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994299520 00000100:00100000:2.0:1788305989.626236:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:2.0:1788305989.626249:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c1259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+7:18759:x1875173994299520:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305989.626329:0:22721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305989.626358:0:22721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e6055526 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08a76 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.626476:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e605552d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.626495:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e605552d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.626508:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e605552d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.626528:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055534 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.626554:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055534 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.626562:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055534 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.626712:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564c00/0x4a426866e605553b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.626722:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183564c00/0x4a426866e605553b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.626729:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183564c00/0x4a426866e605553b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305989.626740:0:22721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788305989.626927:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e605552d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.626936:0:22721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e605552d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.626942:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e605552d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.626949:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183565a00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305989.626954:0:22721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e605552d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.626962:0:22721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e605552d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.626986:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8891c20f9200) 00010000:00010000:2.0:1788305989.626989:0:22721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305989.626994:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e605552d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.627000:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e605552d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.627016:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055534 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.627021:0:22721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055534 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.627026:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055534 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.627031:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183565c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305989.627034:0:22721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055534 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.627040:0:22721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055534 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.627047:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8891c20f9500) 00010000:00010000:2.0:1788305989.627049:0:22721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305989.627052:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055534 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.627057:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055534 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.632415:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e6055526 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a76 expref: 10 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.632452:0:22721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564c00/0x4a426866e605553b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a76 expref: 9 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.632465:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8891c20f9400) 00010000:00010000:2.0:1788305989.632468:0:22721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305989.632473:0:22721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183564c00, rc 0) 00000100:00100000:2.0:1788305989.632586:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c1259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+9:18759:x1875173994299520:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 6338us (8464us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788305989.632597:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:1.0:1788305989.641649:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305989.644770:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994299648 00000100:00100000:2.0:1788305989.644795:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994299648 00000100:00100000:2.0:1788305989.644898:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:2.0:1788305989.644913:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c1249c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+9:18759:x1875173994299648:12345-192.168.202.55@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788305989.645089:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c1249c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+9:18759:x1875173994299648:12345-192.168.202.55@tcp:59:lhsmtool_posix.0 Request processed in 178us (3465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305989.645097:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:3.0:1788305989.653510:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305989.654395:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994299776 00000100:00100000:0.0:1788305989.654485:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994299776 00000100:00100000:0.0:1788305989.654636:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 26 00000100:00100000:0.0:1788305989.654663:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+5:18759:x1875173994299776:12345-192.168.202.55@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1788305989.655495:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1788305989.659530:0:23939:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4789us 00000100:00100000:1.0:1788305989.700515:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+5:18759:x1875173994299776:12345-192.168.202.55@tcp:59:lhsmtool_posix.0 Request processed in 45840us (47005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305989.700534:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 26 00000100:00100000:1.0:1788305989.700683:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305989.700875:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994299904 00000100:00100000:1.0:1788305989.700886:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994299904 00000100:00100000:1.0:1788305989.701192:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 27 00000100:00100000:1.0:1788305989.701209:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c124b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+9:18765:x1875173994299904:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788305989.701234:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305989.701265:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e6055549 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08a7d expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.701397:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e6055550 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.701414:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e6055550 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.701431:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e6055550 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.708297:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e6055557 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.708327:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e6055557 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.708339:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e6055557 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.708531:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e6055550 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.708539:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e6055550 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.708546:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e6055550 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.708551:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7de800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305989.708556:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e6055550 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.708563:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e6055550 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.708575:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88918c769b00) 00010000:00010000:1.0:1788305989.708578:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305989.708583:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e6055550 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.708589:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e6055550 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.708605:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e6055557 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.708611:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e6055557 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.708617:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e6055557 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.708629:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7de600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305989.708632:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e6055557 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.708648:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e6055557 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.708657:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8891bb166f00) 00010000:00010000:1.0:1788305989.708660:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305989.708663:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e6055557 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.708668:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e6055557 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.708717:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e6055549 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a7d expref: 10 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.708729:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88918c769b00) 00010000:00010000:1.0:1788305989.708731:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305989.708735:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e6055549 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a7d expref: 10 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.708744:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88919d7df800, rc 0) 00000100:00100000:1.0:1788305989.708909:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c124b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+9:18765:x1875173994299904:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 7703us (8231us total) trans 0 rc 301/301 00000100:00100000:1.0:1788305989.708919:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 27 00000040:00080000:2.0:1788305989.721883:0:22756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788305989.733764:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305989.734142:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994300032 00000100:00100000:2.0:1788305989.734159:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994300032 00000100:00100000:2.0:1788305989.734230:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:2.0:1788305989.734243:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c1249880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+9:18765:x1875173994300032:12345-192.168.202.55@tcp:700:lfs.0 00000100:00100000:2.0:1788305989.734606:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c1249880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+9:18765:x1875173994300032:12345-192.168.202.55@tcp:700:lfs.0 Request processed in 148us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305989.734629:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:2.0:1788305989.738709:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305989.738966:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994300288 00000100:00100000:0.0:1788305989.738981:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994300288 00000100:00100000:0.0:1788305989.739075:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00100000:0.0:1788305989.739090:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+9:18765:x1875173994300288:12345-192.168.202.55@tcp:36:lfs.0 00010000:00010000:0.0:1788305989.739169:0:22721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305989.739208:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181682600/0x4a426866e6055477 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe089ea expref: 9 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.739234:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88918c769b00) 00010000:00010000:0.0:1788305989.739241:0:22721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788305989.739361:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e605555e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.739613:0:22721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181683000/0x4a426866e60554b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a5a expref: 5 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.739625:0:22721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e605555e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.739694:0:22721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889181683000/0x4a426866e60554b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a5a expref: 5 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.739712:0:22721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889181683000/0x4a426866e60554b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a5a expref: 5 pid: 23939 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305989.739732:0:22721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22721:1875174015393152:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788305989.739966:0:22721:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825ba9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305989.747427:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305989.747561:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305989.747594:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305989.747626:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305989.747659:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305989.747888:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305989.747920:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305989.747999:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994300800 00000100:00100000:0.0:1788305989.748011:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994300800 00000100:00100000:0.0:1788305989.748100:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994300928 00000100:00100000:0.0:1788305989.748104:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994300928 00000100:00100000:0.0:1788305989.749185:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 57 00000100:00100000:0.0:1788305989.749203:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c124a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:2397:x1875173994300800:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305989.749338:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c124a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:2397:x1875173994300800:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 140us (1775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305989.749347:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 57 00000100:00100000:0.0:1788305989.749369:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 58 00000100:00100000:0.0:1788305989.749377:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c1249180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+5:2397:x1875173994300928:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305989.749434:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c1249180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+5:2397:x1875173994300928:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 57us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305989.749460:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 58 00000100:00100000:1.0:1788305989.750648:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994300416 00000100:00100000:1.0:1788305989.750681:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994300416 00000100:00100000:1.0:1788305989.750744:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 167 00000100:00100000:1.0:1788305989.750754:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908309ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+13:2397:x1875173994300416:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305989.750817:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908309ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3f8ba539-95ac-42db-9f6d-9f19c8062908+13:2397:x1875173994300416:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 65us (3191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305989.750826:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 167 00000100:00100000:2.0:1788305989.752009:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994300544 00000100:00100000:2.0:1788305989.752021:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994300544 00000100:00100000:2.0:1788305989.752072:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994301056 00000100:00100000:2.0:1788305989.752076:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994301056 00000100:00100000:2.0:1788305989.752089:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994300672 00000100:00100000:2.0:1788305989.752091:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994300672 00000100:00100000:2.0:1788305989.752103:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994301184 00000100:00100000:2.0:1788305989.752105:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994301184 00000100:00100000:2.0:1788305989.752135:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:2.0:1788305989.752145:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d11cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+5:2397:x1875173994300544:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305989.752225:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d11cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+5:2397:x1875173994300544:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 82us (4814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305989.752232:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:2.0:1788305989.752553:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:2.0:1788305989.752562:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c124aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e482d8f-ec3a-4afe-a831-3f7381c98170+5:2397:x1875173994301056:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305989.752592:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c124aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e482d8f-ec3a-4afe-a831-3f7381c98170+5:2397:x1875173994301056:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 33us (4998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305989.752598:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:2.0:1788305989.752612:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:2.0:1788305989.752618:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c124b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+5:2397:x1875173994300672:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305989.752652:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c124b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+5:2397:x1875173994300672:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 34us (4993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305989.752659:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:2.0:1788305989.752705:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00100000:2.0:1788305989.752711:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c1249500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e482d8f-ec3a-4afe-a831-3f7381c98170+5:2397:x1875173994301184:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305989.752735:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c1249500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8e482d8f-ec3a-4afe-a831-3f7381c98170+5:2397:x1875173994301184:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 25us (4815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305989.752741:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00080000:0.0:1788305989.754355:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305989.754366:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788305989.754370:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305989.754373:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305989.756341:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305989.756581:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994301312 00000100:00100000:3.0:1788305989.756593:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994301312 00000100:00100000:0.0:1788305989.756617:0:22721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22721:1875174015393152:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305989.756655:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181683000/0x4a426866e60554b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a5a expref: 6 pid: 23939 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.756658:0:22721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e605555e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305989.756702:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:3.0:1788305989.756714:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c1249f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:2395:x1875173994301312:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305989.756732:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305989.756740:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889181683000/0x4a426866e60554b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a5a expref: 6 pid: 23939 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305989.756771:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889181683000/0x4a426866e60554b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a5a expref: 6 pid: 23939 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305989.756800:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181683000/0x4a426866e60554b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a5a expref: 6 pid: 23939 timeout: 919 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305989.756822:0:22709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88918c769b00) 00010000:00010000:3.0:1788305989.756828:0:22709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e605555e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305989.756839:0:22709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e605555e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305989.756848:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e605555e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305989.756870:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305989.756939:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c1249f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e482d8f-ec3a-4afe-a831-3f7381c98170+5:2395:x1875173994301312:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 226us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305989.756958:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 15 00010000:00010000:0.0:1788305989.757227:0:22721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e605555e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.757234:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e605555e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.757261:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6055565 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.757272:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6055565 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.757601:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6055565 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.762969:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605556c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.763002:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605556c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.763016:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605556c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788305989.763049:0:22721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063a5a18c reply state 00000000acd5e85e transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605556c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.763064:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605556c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.763072:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8891885c8100) 00010000:00010000:0.0:1788305989.763075:0:22721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788305989.763081:0:22721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788305989.763088:0:22721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788305989.763097:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e605555e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.763103:0:22721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e605555e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.763110:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e605555e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.763117:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305989.763122:0:22721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e605555e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.763129:0:22721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e605555e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.763141:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88918c769b00) 00010000:00010000:0.0:1788305989.763143:0:22721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305989.763148:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e605555e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.763164:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e605555e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788305989.763188:0:22721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063a5a18c reply state 00000000acd5e85e transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6055565 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.763198:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6055565 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.763204:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8891885c8b00) 00010000:00010000:0.0:1788305989.763207:0:22721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788305989.763209:0:22721:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788305989.763656:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+10:18765:x1875173994300288:12345-192.168.202.55@tcp:36:lfs.0 Request processed in 24553us (24947us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788305989.763746:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 28 00000040:00080000:3.0:1788305989.851083:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788305989.886763:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305989.886963:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994301440 00000100:00100000:0.0:1788305989.886978:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994301440 00000100:00100000:0.0:1788305989.887059:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 29 00000100:00100000:0.0:1788305989.887073:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c1248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+10:18773:x1875173994301440:12345-192.168.202.55@tcp:101:lctl.0 00010000:00010000:0.0:1788305989.887110:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305989.887151:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6055573 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08a84 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.887242:0:22722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e605557a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.887259:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e605557a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.887359:0:22722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e605557a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305989.887618:0:22722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788305989.887623:0:22722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788305989.887697:0:22722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e605557a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.887731:0:22722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6055573 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a84 expref: 12 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.887755:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e605557a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a84 expref: 11 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.887766:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891885c8800) 00010000:00010000:0.0:1788305989.887769:0:22722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788305989.887773:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9c00, rc 0) 00000100:00100000:0.0:1788305989.887864:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c1248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+11:18773:x1875173994301440:12345-192.168.202.55@tcp:101:lctl.0 Request processed in 793us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305989.887872:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 29 00000100:00100000:2.0:1788305989.935066:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305989.938536:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994301568 00000100:00100000:1.0:1788305989.938560:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994301568 00000100:00100000:1.0:1788305989.938859:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:1.0:1788305989.938875:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e482d8f-ec3a-4afe-a831-3f7381c98170+5:18774:x1875173994301568:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788305989.938904:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305989.938934:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dee00/0x4a426866e6055581 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08a8b expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.939041:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df200/0x4a426866e6055588 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.939060:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df200/0x4a426866e6055588 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.939097:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df200/0x4a426866e6055588 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305989.939184:0:22723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788305989.939190:0:22723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788305989.939222:0:22723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df200/0x4a426866e6055588 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.939256:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dee00/0x4a426866e6055581 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a8b expref: 7 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.939324:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df200/0x4a426866e6055588 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a8b expref: 6 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.939336:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891885c8800) 00010000:00010000:1.0:1788305989.939339:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788305989.939344:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88919d7df200, rc 0) 00000100:00100000:1.0:1788305989.939454:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:18774:x1875173994301568:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 583us (4405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305989.939462:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:2.0:1788305989.943196:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305989.943913:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994301696 00000100:00100000:1.0:1788305989.943929:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994301696 00000100:00100000:1.0:1788305989.944017:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 31 00000100:00100000:1.0:1788305989.944030:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:18774:x1875173994301696:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788305989.944060:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305989.944088:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e605558f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08a92 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.944220:0:22722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055596 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.944238:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055596 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.944252:0:22722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055596 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.944265:0:22722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e605559d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.944272:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e605559d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.944311:0:22722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e605559d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.945072:0:22722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e60555a4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.945088:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e60555a4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.945096:0:22722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e60555a4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305989.945258:0:22722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788305989.945263:0:22722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788305989.945326:0:22722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e60555a4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.945357:0:22722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055596 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.945364:0:22722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055596 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.945385:0:22722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055596 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.945392:0:22722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7dea00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305989.945513:0:22722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055596 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.945524:0:22722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055596 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.945538:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891885c8800) 00010000:00010000:1.0:1788305989.945541:0:22722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305989.945546:0:22722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055596 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.945553:0:22722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055596 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.945572:0:22722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e605559d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.945579:0:22722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e605559d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.945585:0:22722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e605559d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.945596:0:22722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7de800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305989.945599:0:22722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e605559d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.945604:0:22722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e605559d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.945612:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8891885c8b00) 00010000:00010000:1.0:1788305989.945615:0:22722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305989.945618:0:22722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e605559d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.945623:0:22722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e605559d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.945804:0:22722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e605558f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a92 expref: 8 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.945821:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e60555a4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a92 expref: 7 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.945829:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8891885c8100) 00010000:00010000:1.0:1788305989.945832:0:22722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788305989.945835:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88919d7de600, rc 0) 00000100:00100000:1.0:1788305989.945947:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+7:18774:x1875173994301696:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 1918us (2765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305989.946072:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 31 00000100:00100000:3.0:1788305989.950422:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305989.951048:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994301824 00000100:00100000:1.0:1788305989.951080:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994301824 00000100:00100000:2.0:1788305989.951300:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:2.0:1788305989.951315:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8e482d8f-ec3a-4afe-a831-3f7381c98170+5:18774:x1875173994301824:12345-192.168.202.55@tcp:900:lfs.0 00000100:00100000:2.0:1788305989.951455:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8e482d8f-ec3a-4afe-a831-3f7381c98170+5:18774:x1875173994301824:12345-192.168.202.55@tcp:900:lfs.0 Request processed in 143us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305989.951466:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:3.0:1788305989.958884:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305989.958998:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994302080 00000100:00100000:0.0:1788305989.959012:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994302080 00000100:00100000:0.0:1788305989.959100:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 32 00000100:00100000:0.0:1788305989.959112:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e482d8f-ec3a-4afe-a831-3f7381c98170+7:18774:x1875173994302080:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788305989.959263:0:22721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305989.959331:0:22721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60555ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08a99 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305989.959614:0:22721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788305989.959857:0:22721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60555ab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a99 expref: 9 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.959876:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891885c8800) 00010000:00010000:0.0:1788305989.959879:0:22721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788305989.959884:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60555ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a99 expref: 9 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.959903:0:22721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8c00, rc 0) 00000100:00100000:0.0:1788305989.959992:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8e482d8f-ec3a-4afe-a831-3f7381c98170+8:18774:x1875173994302080:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 882us (1121us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1788305989.960000:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 32 00000100:00100000:3.0:1788305989.963083:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305989.963465:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994302336 00000100:00100000:0.0:1788305989.963479:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994302336 00000100:00100000:0.0:1788305989.963547:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00100000:0.0:1788305989.963560:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+8:18774:x1875173994302336:12345-192.168.202.55@tcp:36:lfs.0 00010000:00010000:0.0:1788305989.963648:0:22722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305989.963983:0:22722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e60555a4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08a92 expref: 8 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.964011:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8891885c8100) 00010000:00010000:0.0:1788305989.964018:0:22722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788305989.964053:0:22722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60555b9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.964097:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60555b9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305989.964376:0:22722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60555b9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788305989.965087:0:22722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4ea71be reply state 000000004995c838 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60555b9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.965368:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60555b9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.965382:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8891885c8100) 00010000:00010000:2.0:1788305989.965385:0:22722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788305989.965391:0:22722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788305989.965511:0:22722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788305989.965661:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+9:18774:x1875173994302336:12345-192.168.202.55@tcp:36:lfs.0 Request processed in 2099us (2588us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788305989.966008:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00100000:1.0:1788305989.969092:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305989.969588:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994302592 00000100:00100000:3.0:1788305989.969603:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994302592 00000100:00100000:2.0:1788305989.969891:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:2.0:1788305989.969907:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c124b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+9:18774:x1875173994302592:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788305989.970664:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c124b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+10:18774:x1875173994302592:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 754us (1582us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788305989.970742:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:3.0:1788305989.973911:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305989.974074:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994302848 00000100:00100000:1.0:1788305989.974091:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994302848 00000100:00100000:1.0:1788305989.974189:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 34 00000100:00100000:1.0:1788305989.974201:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e482d8f-ec3a-4afe-a831-3f7381c98170+10:18774:x1875173994302848:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788305989.974235:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305989.974264:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e60555c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08aa0 expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.974417:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60555c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.974435:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60555c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.974447:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60555c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.974461:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e60555ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.974469:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e60555ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.974475:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e60555ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305989.974614:0:22723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788305989.975192:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60555c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.975228:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60555c7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.975235:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60555c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.975241:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7de800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305989.975247:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60555c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.975255:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60555c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.975483:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891885c8800) 00010000:00010000:1.0:1788305989.975489:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305989.975495:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60555c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.975503:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60555c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.975526:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e60555ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.975532:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e60555ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.975538:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e60555ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.975543:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7dea00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305989.975553:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e60555ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.975560:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e60555ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.975569:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8891885c8b00) 00010000:00010000:1.0:1788305989.975572:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305989.975575:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e60555ce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.975581:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e60555ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.975647:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e60555c0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aa0 expref: 12 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.975659:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891885c8800) 00010000:00010000:1.0:1788305989.975661:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788305989.975665:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e60555c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aa0 expref: 12 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305989.975845:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88919d7df000, rc 0) 00000100:00100000:1.0:1788305989.976010:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e482d8f-ec3a-4afe-a831-3f7381c98170+11:18774:x1875173994302848:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 1809us (2113us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1788305989.976019:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 34 00000100:00100000:1.0:1788305989.982954:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305989.983046:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994302976 00000100:00100000:2.0:1788305989.983060:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994302976 00000100:00100000:2.0:1788305989.983901:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 35 00000100:00100000:2.0:1788305989.983920:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c1248700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e482d8f-ec3a-4afe-a831-3f7381c98170+11:18774:x1875173994302976:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788305989.983955:0:23939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305989.983985:0:23939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183565e00/0x4a426866e60555dc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08aa7 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.984139:0:23939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e60555e3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.984164:0:23939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e60555e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.984177:0:23939:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e60555e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305989.984210:0:23939:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788305989.984214:0:23939:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788305989.984241:0:23939:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e60555e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.984300:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183565e00/0x4a426866e60555dc lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aa7 expref: 13 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.984323:0:23939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e60555e3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aa7 expref: 12 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305989.984351:0:23939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8891885c8100) 00010000:00010000:2.0:1788305989.984354:0:23939:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305989.984359:0:23939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183565400, rc 0) 00000100:00100000:2.0:1788305989.984459:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c1248700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8e482d8f-ec3a-4afe-a831-3f7381c98170+12:18774:x1875173994302976:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 546us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305989.984468:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 35 00000100:00100000:2.0:1788305989.990230:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305989.990557:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994303104 00000100:00100000:1.0:1788305989.990572:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994303104 00000100:00100000:1.0:1788305989.990699:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:1.0:1788305989.990736:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e482d8f-ec3a-4afe-a831-3f7381c98170+12:18774:x1875173994303104:12345-192.168.202.55@tcp:37:lfs.0 00000100:00100000:1.0:1788305989.996074:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8e482d8f-ec3a-4afe-a831-3f7381c98170+12:18774:x1875173994303104:12345-192.168.202.55@tcp:37:lfs.0 Request processed in 5321us (5965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305989.996091:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:3.0:1788305990.000488:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305990.000865:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994303360 00000100:00100000:2.0:1788305990.000880:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994303360 00000100:00100000:2.0:1788305990.000942:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:2.0:1788305990.000955:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa50c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+12:18774:x1875173994303360:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:0.0:1788305990.001985:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa50c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+13:18774:x1875173994303360:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 1023us (1505us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788305990.001997:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:2.0:1788305990.101865:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305990.112193:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908202c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015393280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305990.112333:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305990.112712:0:23464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015393280 00000100:00100000:1.0:1788305990.112725:0:23464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015393280 00000100:00100000:1.0:1788305990.112807:0:23464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788305990.112819:0:23464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015393280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788305990.112872:0:23464:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788305990.112946:0:23464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015393280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305990.112955:0:23464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788305990.113362:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908202c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015393280:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305990.113844:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305990.113951:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994303488 00000100:00100000:0.0:1788305990.113959:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994303488 00000100:00100000:0.0:1788305990.114013:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00100000:0.0:1788305990.114023:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+11:18780:x1875173994303488:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788305990.114040:0:22721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305990.114066:0:22721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60555ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08aae expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114167:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e60555f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114184:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e60555f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114199:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e60555f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114212:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e60555f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114244:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e60555f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114251:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e60555f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114388:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e60555ff lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114400:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e60555ff lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114419:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e60555ff lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305990.114466:0:22721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788305990.114471:0:22721:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788305990.114523:0:22721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e60555ff lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114538:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e60555f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114546:0:22721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e60555f1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114553:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e60555f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114560:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305990.114565:0:22721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e60555f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114580:0:22721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e60555f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114596:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891885c8800) 00010000:00010000:0.0:1788305990.114600:0:22721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305990.114606:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e60555f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114612:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e60555f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114630:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e60555f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114648:0:22721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e60555f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114654:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e60555f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114659:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305990.114662:0:22721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e60555f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114669:0:22721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e60555f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114677:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8891885c8b00) 00010000:00010000:0.0:1788305990.114680:0:22721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305990.114684:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e60555f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114702:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e60555f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114738:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60555ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aae expref: 13 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114753:0:22721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e60555ff lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aae expref: 12 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.114761:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8891885c8100) 00010000:00010000:0.0:1788305990.114763:0:22721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788305990.114766:0:22721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9000, rc 0) 00000100:00100000:0.0:1788305990.114841:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+12:18780:x1875173994303488:12345-192.168.202.55@tcp:101:bash.0 Request processed in 820us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305990.114847:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00100000:2.0:1788305990.119380:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305990.119599:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994303616 00000100:00100000:3.0:1788305990.119613:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994303616 00000100:00100000:3.0:1788305990.119705:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:3.0:1788305990.119717:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+5:18780:x1875173994303616:12345-192.168.202.55@tcp:900:bash.0 00000100:00100000:3.0:1788305990.119830:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+5:18780:x1875173994303616:12345-192.168.202.55@tcp:900:bash.0 Request processed in 114us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305990.119839:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:3.0:1788305990.130920:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305990.131599:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994303872 00000100:00100000:2.0:1788305990.131616:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994303872 00000100:00100000:2.0:1788305990.131730:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 37 00000100:00100000:2.0:1788305990.131744:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+12:18780:x1875173994303872:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788305990.131776:0:23939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305990.131805:0:23939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183565e00/0x4a426866e6055606 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08ab5 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305990.131965:0:23939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605560d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305990.131999:0:23939:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e60555e3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aa7 expref: 12 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305990.132010:0:23939:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605560d lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305990.132059:0:23939:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e60555e3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aa7 expref: 12 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305990.132075:0:23939:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e60555e3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aa7 expref: 12 pid: 23939 timeout: 920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305990.132092:0:23939:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23939:1875174015393408:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788305990.140405:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305990.140541:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994304000 00000100:00100000:1.0:1788305990.140554:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994304000 00010000:00010000:1.0:1788305990.140612:0:22708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e60555e3 lrc: 6/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aa7 expref: 13 pid: 23939 timeout: 920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305990.140691:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:1.0:1788305990.140703:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+13:2396:x1875173994304000:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305990.140725:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305990.140734:0:22708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e60555e3 lrc: 6/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aa7 expref: 13 pid: 23939 timeout: 920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305990.140750:0:22708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e60555e3 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aa7 expref: 13 pid: 23939 timeout: 920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305990.140780:0:22708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8891885c8100) 00010000:00010000:1.0:1788305990.140801:0:22708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605560d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305990.140813:0:22708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605560d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305990.140820:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605560d lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305990.140846:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305990.140928:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+13:2396:x1875173994304000:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 227us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305990.140937:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:0.0:1788305990.145530:0:23939:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891baf65cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1788305990.145606:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e60555e3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aa7 expref: 12 pid: 23939 timeout: 920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305990.145650:0:23939:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23939:1875174015393408:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788305990.146120:0:23939:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605560d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.146133:0:23939:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605560d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.146140:0:23939:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605560d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.153851:0:23939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e6055614 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.153876:0:23939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e6055614 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.153891:0:23939:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e6055614 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.154433:0:23939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e605561b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.154446:0:23939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e605561b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.154454:0:23939:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e605561b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305990.154465:0:23939:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788305990.154492:0:23939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605560d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.154499:0:23939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605560d lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.154506:0:23939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605560d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.154512:0:23939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183564800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305990.154517:0:23939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605560d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.154538:0:23939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605560d lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.154551:0:23939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8891885c8100) 00010000:00010000:0.0:1788305990.154554:0:23939:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305990.154558:0:23939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605560d lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.154564:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605560d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788305990.154578:0:23939:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000749c5e73 reply state 000000007bce328b transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e6055614 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.154589:0:23939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e6055614 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.154595:0:23939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8891885c8500) 00010000:00010000:0.0:1788305990.154598:0:23939:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788305990.154601:0:23939:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788305990.154651:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183565e00/0x4a426866e6055606 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08ab5 expref: 15 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.154667:0:23939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e605561b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08ab5 expref: 14 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.154675:0:23939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:0.0:1788305990.154677:0:23939:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788305990.154680:0:23939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eba00, rc 0) 00000100:00100000:0.0:1788305990.154767:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+15:18780:x1875173994303872:12345-192.168.202.55@tcp:101:bash.0 Request processed in 23026us (23864us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1788305990.154777:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 37 00000100:00100000:3.0:1788305990.198509:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305990.202665:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994304128 00000100:00100000:0.0:1788305990.202680:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994304128 00000100:00100000:0.0:1788305990.202762:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 38 00000100:00100000:0.0:1788305990.202774:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+15:18780:x1875173994304128:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788305990.202801:0:22721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305990.202822:0:22721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6055629 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08abc expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.202890:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6055630 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.202904:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6055630 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.202914:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6055630 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305990.202965:0:22721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788305990.202970:0:22721:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788305990.202988:0:22721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6055630 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.203010:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6055630 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.203036:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6055629 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08abc expref: 17 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.203077:0:22721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6055630 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08abc expref: 16 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.203086:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:0.0:1788305990.203089:0:22721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305990.203093:0:22721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb200, rc 0) 00000100:00100000:0.0:1788305990.203168:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+16:18780:x1875173994304128:12345-192.168.202.55@tcp:101:bash.0 Request processed in 395us (4672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305990.203175:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 38 00000100:00100000:3.0:1788305990.221740:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305990.222540:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994304384 00000100:00100000:1.0:1788305990.222552:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994304384 00000100:00100000:1.0:1788305990.222656:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:1.0:1788305990.222667:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+16:18780:x1875173994304384:12345-192.168.202.55@tcp:35:bash.0 00000100:00100000:1.0:1788305990.222945:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+17:18780:x1875173994304384:12345-192.168.202.55@tcp:35:bash.0 Request processed in 279us (1213us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1788305990.222953:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 5 00010000:00010000:2.0:1788305990.359865:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305990.391887:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305990.400865:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994304640 00000100:00100000:1.0:1788305990.400890:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994304640 00000100:00100000:1.0:1788305990.401350:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 39 00000100:00100000:1.0:1788305990.401365:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+17:18790:x1875173994304640:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788305990.402548:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305990.402590:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e6055637 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08ac3 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305990.403571:0:22722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788305990.404650:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e6055637 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08ac3 expref: 19 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305990.405415:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891885c8800) 00010000:00010000:1.0:1788305990.405420:0:22722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788305990.405429:0:22722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e6055637 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08ac3 expref: 19 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305990.405452:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88919d7df000, rc 0) 00000100:00100000:1.0:1788305990.405566:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+18:18790:x1875173994304640:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 4203us (13694us total) trans 12884901898 rc 301/301 00000100:00100000:1.0:1788305990.405576:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 39 00000100:00100000:3.0:1788305990.408512:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305990.408688:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994304896 00000100:00100000:0.0:1788305990.408703:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994304896 00000100:00100000:0.0:1788305990.408781:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:0.0:1788305990.408790:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+18:18790:x1875173994304896:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:0.0:1788305990.409032:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+19:18790:x1875173994304896:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 242us (540us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1788305990.409041:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:3.0:1788305990.467988:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305990.470895:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994305152 00000100:00100000:0.0:1788305990.470924:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994305152 00000100:00100000:2.0:1788305990.471218:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 40 00000100:00100000:2.0:1788305990.471233:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+19:18793:x1875173994305152:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788305990.471262:0:22721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305990.471310:0:22721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e6055645 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08aca expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305990.471416:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565e00/0x4a426866e605564c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305990.471430:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183565e00/0x4a426866e605564c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305990.471440:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183565e00/0x4a426866e605564c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305990.471465:0:22721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788305990.471561:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e6055645 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aca expref: 22 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305990.471579:0:22721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565e00/0x4a426866e605564c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aca expref: 21 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305990.471588:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:2.0:1788305990.471590:0:22721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305990.471594:0:22721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183565e00, rc 0) 00000100:00100000:2.0:1788305990.471666:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+21:18793:x1875173994305152:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 437us (3694us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1788305990.471673:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 40 00000100:00100000:3.0:1788305990.475214:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305990.479205:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305990.479387:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994305408 00000100:00100000:1.0:1788305990.479404:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994305408 00000100:00100000:1.0:1788305990.479496:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:1.0:1788305990.479507:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+21:2397:x1875173994305408:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305990.479526:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305990.479552:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183565e00/0x4a426866e605564c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aca expref: 21 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305990.479574:0:22709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:1.0:1788305990.479580:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305990.479659:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+20:2397:x1875173994305408:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 153us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305990.479667:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:0.0:1788305990.483407:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994305280 00000100:00100000:0.0:1788305990.483432:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994305280 00000100:00100000:0.0:1788305990.483515:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 41 00000100:00100000:0.0:1788305990.483529:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+20:18793:x1875173994305280:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:0.0:1788305990.483646:0:23939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e605565a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.483909:0:23939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e605565a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.483949:0:23939:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e605565a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.484003:0:23939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e605565a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.484010:0:23939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e605565a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.484017:0:23939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e605565a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.484024:0:23939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebe00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305990.484030:0:23939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e605565a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.484039:0:23939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e605565a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.484055:0:23939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:0.0:1788305990.484058:0:23939:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788305990.484064:0:23939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e605565a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305990.484071:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e605565a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305990.484210:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+20:18793:x1875173994305280:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 682us (9007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305990.484220:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 41 00000100:00100000:3.0:1788305990.500572:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305990.500689:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994305664 00000100:00100000:0.0:1788305990.500703:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994305664 00000100:00100000:0.0:1788305990.500775:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:0.0:1788305990.500788:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+20:18793:x1875173994305664:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:0.0:1788305990.501093:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+21:18793:x1875173994305664:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 307us (718us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1788305990.501102:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:1.0:1788305990.614092:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891c124ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015393536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788305990.614222:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305990.614707:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015393536 00000100:00100000:3.0:1788305990.614720:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015393536 00000100:00100000:3.0:1788305990.614821:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788305990.614834:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c124bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015393536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788305990.614865:0:24234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788305990.614932:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c124bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015393536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305990.614940:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788305990.614998:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891c124ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015393536:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788305990.616977:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788305990.745466:0:22756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788305990.914954:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305990.915159:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994305920 00000100:00100000:1.0:1788305990.915174:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994305920 00000100:00100000:1.0:1788305990.915257:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 42 00000100:00100000:1.0:1788305990.915271:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+21:18824:x1875173994305920:12345-192.168.202.55@tcp:101:cat.0 00010000:00010000:1.0:1788305990.915349:0:22721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305990.915383:0:22721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e6055661 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08ad1 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305990.915545:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055668 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305990.915564:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055668 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305990.915582:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055668 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305990.915597:0:22721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788305990.915810:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e6055661 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08ad1 expref: 24 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305990.915835:0:22721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055668 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08ad1 expref: 23 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305990.915845:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:1.0:1788305990.915848:0:22721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788305990.915866:0:22721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88919d7dea00, rc 0) 00000100:00100000:1.0:1788305990.916452:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+23:18824:x1875173994305920:12345-192.168.202.55@tcp:101:cat.0 Request processed in 1180us (1522us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1788305990.916484:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 42 00000100:00100000:3.0:1788305990.930800:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305990.930844:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305990.930945:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994306176 00000100:00100000:0.0:1788305990.930959:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994306176 00000100:00100000:0.0:1788305990.931032:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:0.0:1788305990.931045:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c124ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+23:18824:x1875173994306176:12345-192.168.202.55@tcp:35:cat.0 00000100:00100000:1.0:1788305990.931554:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994306304 00000100:00100000:1.0:1788305990.931561:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994306304 00000100:00100000:1.0:1788305990.931606:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 1 00000100:00100000:1.0:1788305990.931614:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c124f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+25:2398:x1875173994306304:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305990.931637:0:22707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305990.931670:0:22707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055668 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08ad1 expref: 25 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305990.931692:0:22707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:1.0:1788305990.931699:0:22707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305990.932715:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c124ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+24:18824:x1875173994306176:12345-192.168.202.55@tcp:35:cat.0 Request processed in 1663us (1917us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1788305990.932729:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:1.0:1788305990.933055:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c124f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+23:2398:x1875173994306304:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 1439us (2208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305990.933064:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 1 00000100:00100000:3.0:1788305991.089598:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305991.090337:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994306560 00000100:00100000:1.0:1788305991.090353:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994306560 00000100:00100000:1.0:1788305991.090547:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 43 00000100:00100000:1.0:1788305991.090563:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c124d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+23:18830:x1875173994306560:12345-192.168.202.55@tcp:101:dd.0 00010000:00010000:1.0:1788305991.090604:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305991.090643:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055676 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08ad8 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788305991.091042:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788305991.092586:0:22722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e605567d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.092609:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e605567d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.092654:0:22722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e605567d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305991.092752:0:22722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788305991.093140:0:22722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055676 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08ad8 expref: 26 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.093169:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e605567d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08ad8 expref: 25 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.093179:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:1.0:1788305991.093183:0:22722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788305991.093187:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88919d7df000, rc 0) 00000100:00100000:1.0:1788305991.094017:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c124d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+25:18830:x1875173994306560:12345-192.168.202.55@tcp:101:dd.0 Request processed in 3453us (4429us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1788305991.094030:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 43 00000100:00100000:3.0:1788305991.100037:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305991.100197:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994306688 00000100:00100000:1.0:1788305991.100219:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994306688 00000100:00100000:1.0:1788305991.100333:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:1.0:1788305991.100349:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c124d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+25:18830:x1875173994306688:12345-192.168.202.55@tcp:101:dd.0 00010000:00010000:1.0:1788305991.100401:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305991.100434:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e605568b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08adf expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.100480:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dee00/0x4a426866e6055692 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.100521:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dee00/0x4a426866e6055692 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.100535:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dee00/0x4a426866e6055692 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.100860:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e605568b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08adf expref: 27 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.100885:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dee00/0x4a426866e6055692 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08adf expref: 26 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.100894:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:1.0:1788305991.100897:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788305991.100901:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88919d7dee00, rc 0) 00000100:00100000:1.0:1788305991.101037:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c124d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+26:18830:x1875173994306688:12345-192.168.202.55@tcp:101:dd.0 Request processed in 691us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305991.101044:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:0.0:1788305991.102369:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305991.102639:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994306816 00000100:00100000:3.0:1788305991.102649:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994306816 00000100:00100000:3.0:1788305991.102734:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:3.0:1788305991.102745:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+26:2398:x1875173994306816:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305991.102761:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305991.102787:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e605567d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08ad8 expref: 26 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.102808:0:22708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:3.0:1788305991.102813:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305991.102864:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+25:2398:x1875173994306816:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 121us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305991.102872:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:0.0:1788305991.114723:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305991.114923:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994307072 00000100:00100000:2.0:1788305991.114949:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994307072 00000100:00100000:2.0:1788305991.115035:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 45 00000100:00100000:2.0:1788305991.115048:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+25:18830:x1875173994307072:12345-192.168.202.55@tcp:36:dd.0 00010000:00010000:2.0:1788305991.115125:0:23939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305991.115165:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6055630 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08abc expref: 25 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305991.115193:0:23939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:2.0:1788305991.115199:0:23939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305991.115516:0:23939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e6055699 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305991.115552:0:23939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e6055699 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305991.115564:0:23939:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e6055699 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788305991.115616:0:23939:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1788305991.115657:0:23939:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013296c62 reply state 00000000009e1cfb transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e6055699 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305991.116181:0:23939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e6055699 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305991.116188:0:23939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:2.0:1788305991.116191:0:23939:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788305991.116195:0:23939:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788305991.116473:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+27:18830:x1875173994307072:12345-192.168.202.55@tcp:36:dd.0 Request processed in 1424us (1762us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1788305991.116482:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 45 00000020:00080000:2.0:1788305991.116488:0:23939:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788305991.278337:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305991.278988:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994307328 00000100:00100000:0.0:1788305991.279003:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994307328 00000100:00100000:0.0:1788305991.279093:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:0.0:1788305991.279106:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c1248380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+27:18830:x1875173994307328:12345-192.168.202.55@tcp:35:dd.0 00000100:00100000:0.0:1788305991.279619:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c1248380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+28:18830:x1875173994307328:12345-192.168.202.55@tcp:35:dd.0 Request processed in 512us (1360us total) trans 12884901907 rc 0/0 00000100:00100000:0.0:1788305991.279638:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 9 00010000:00010000:2.0:1788305991.381593:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305991.616848:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305991.622631:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994307456 00000100:00100000:1.0:1788305991.622718:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994307456 00000100:00100000:1.0:1788305991.622909:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 46 00000100:00100000:1.0:1788305991.622923:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c124df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+28:18844:x1875173994307456:12345-192.168.202.55@tcp:101:stat.0 00010000:00010000:1.0:1788305991.622958:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305991.622987:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60556a0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08ae6 expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623122:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e60556a7 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623142:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e60556a7 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623158:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e60556a7 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623171:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de400/0x4a426866e60556ae lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623179:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de400/0x4a426866e60556ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623185:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de400/0x4a426866e60556ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623334:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e60556b5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623344:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e60556b5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623351:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e60556b5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305991.623421:0:22723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788305991.623427:0:22723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788305991.623495:0:22723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e60556b5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623520:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e60556b5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623530:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e60556a7 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623537:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e60556a7 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623544:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e60556a7 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623551:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7dea00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305991.623556:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e60556a7 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623564:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e60556a7 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623578:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8891885c8100) 00010000:00010000:1.0:1788305991.623582:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305991.623586:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e60556a7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623593:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e60556a7 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623611:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de400/0x4a426866e60556ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623618:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de400/0x4a426866e60556ae lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623640:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de400/0x4a426866e60556ae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623645:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7de400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305991.623657:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de400/0x4a426866e60556ae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623668:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de400/0x4a426866e60556ae lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623677:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8891885c8500) 00010000:00010000:1.0:1788305991.623679:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305991.623682:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de400/0x4a426866e60556ae lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.623688:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de400/0x4a426866e60556ae lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.625408:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60556a0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08ae6 expref: 30 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.625452:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e60556b5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08ae6 expref: 29 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.625462:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:1.0:1788305991.625465:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788305991.625469:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88919d7df000, rc 0) 00000100:00100000:1.0:1788305991.625878:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c124df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+29:18844:x1875173994307456:12345-192.168.202.55@tcp:101:stat.0 Request processed in 2955us (9043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305991.625916:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 46 00000100:00100000:3.0:1788305991.711053:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305991.712208:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994307712 00000100:00100000:1.0:1788305991.712227:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994307712 00000100:00100000:1.0:1788305991.712384:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 47 00000100:00100000:1.0:1788305991.712399:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c124c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+29:18850:x1875173994307712:12345-192.168.202.55@tcp:36:truncate.0 00010000:00010000:1.0:1788305991.712494:0:22722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305991.712539:0:22722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e60556b5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08ae6 expref: 29 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.712570:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:1.0:1788305991.712577:0:22722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305991.712855:0:22722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60556bc lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.712876:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60556bc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.712889:0:22722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60556bc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788305991.712947:0:22722:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:1.0:1788305991.712975:0:22722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f31e866b reply state 00000000eb9c8efc transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60556bc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.712990:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60556bc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305991.712996:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:1.0:1788305991.712999:0:22722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788305991.713021:0:22722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788305991.713178:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c124c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+31:18850:x1875173994307712:12345-192.168.202.55@tcp:36:truncate.0 Request processed in 780us (2138us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1788305991.713187:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 47 00000020:00080000:1.0:1788305991.713194:0:22722:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788305991.942999:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305991.943302:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994307840 00000100:00100000:3.0:1788305991.943316:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994307840 00000100:00100000:3.0:1788305991.943403:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 48 00000100:00100000:3.0:1788305991.943416:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+31:18864:x1875173994307840:12345-192.168.202.55@tcp:101:stat.0 00010000:00010000:3.0:1788305991.943448:0:22721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305991.943475:0:22721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181683000/0x4a426866e60556c3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08aed expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.943588:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181683200/0x4a426866e60556ca lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.943607:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181683200/0x4a426866e60556ca lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.943636:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181683200/0x4a426866e60556ca lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.943651:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556d1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.943659:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556d1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.943666:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556d1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.943765:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e60556d8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.943776:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e60556d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.943783:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e60556d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305991.943838:0:22721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1788305991.943844:0:22721:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788305991.943872:0:22721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e60556d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.943900:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e60556d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.943911:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181683200/0x4a426866e60556ca lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.943918:0:22721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181683200/0x4a426866e60556ca lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.944060:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181683200/0x4a426866e60556ca lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.944068:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181683200 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305991.944073:0:22721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181683200/0x4a426866e60556ca lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.944082:0:22721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181683200/0x4a426866e60556ca lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.944099:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8891885c8100) 00010000:00010000:3.0:1788305991.944103:0:22721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305991.944108:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181683200/0x4a426866e60556ca lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.944116:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181683200/0x4a426866e60556ca lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.944136:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556d1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.944143:0:22721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556d1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.944157:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556d1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.944264:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181683a00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305991.944270:0:22721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556d1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.944343:0:22721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556d1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.944352:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8891885c8500) 00010000:00010000:3.0:1788305991.944354:0:22721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305991.944358:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556d1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.944364:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556d1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.944401:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181683000/0x4a426866e60556c3 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aed expref: 33 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.944417:0:22721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e60556d8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aed expref: 32 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305991.944426:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:3.0:1788305991.944428:0:22721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788305991.944431:0:22721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181682a00, rc 0) 00000100:00100000:3.0:1788305991.944518:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+32:18864:x1875173994307840:12345-192.168.202.55@tcp:101:stat.0 Request processed in 1105us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305991.944538:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 48 00000100:00100000:0.0:1788305992.088817:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305992.089663:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994308096 00000100:00100000:1.0:1788305992.089678:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994308096 00000100:00100000:1.0:1788305992.089767:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 49 00000100:00100000:1.0:1788305992.089780:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+32:18874:x1875173994308096:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788305992.089809:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305992.089839:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e60556df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08af4 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305992.090015:0:22722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788305992.090362:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e60556df lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08af4 expref: 34 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.090512:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891885c8800) 00010000:00010000:1.0:1788305992.090517:0:22722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788305992.090524:0:22722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e60556df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08af4 expref: 34 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.090544:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88919d7df000, rc 0) 00000100:00100000:1.0:1788305992.090651:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+33:18874:x1875173994308096:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 873us (1851us total) trans 12884901910 rc 301/301 00000100:00100000:1.0:1788305992.090660:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 49 00000100:00100000:3.0:1788305992.097005:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305992.097124:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994308352 00000100:00100000:0.0:1788305992.097138:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994308352 00000100:00100000:0.0:1788305992.097426:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:0.0:1788305992.097440:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa53c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+33:18874:x1875173994308352:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:0.0:1788305992.097763:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa53c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+34:18874:x1875173994308352:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 325us (914us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1788305992.097772:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:0.0:1788305992.258499:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305992.258754:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994308608 00000100:00100000:3.0:1788305992.258780:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994308608 00000100:00100000:3.0:1788305992.258864:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00100000:3.0:1788305992.258878:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+34:18880:x1875173994308608:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:3.0:1788305992.258919:0:22721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305992.258949:0:22721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181683000/0x4a426866e60556ed lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08afb expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305992.259136:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556f4 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305992.259156:0:22721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e605561b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08ab5 expref: 35 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305992.259167:0:22721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e60556d8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aed expref: 35 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305992.259177:0:22721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556f4 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305992.259225:0:22721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e60556d8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aed expref: 35 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305992.259242:0:22721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e60556d8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aed expref: 35 pid: 22721 timeout: 922 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305992.259341:0:22721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891c124f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22721:1875174015393664:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305992.259486:0:22721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e605561b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08ab5 expref: 35 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305992.259496:0:22721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e605561b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08ab5 expref: 35 pid: 23939 timeout: 922 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305992.259506:0:22721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891c124c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22721:1875174015393792:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788305992.259535:0:22721:0:(client.c:2715:ptlrpc_set_wait()) set ffff889182f616c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305992.274720:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305992.274778:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305992.274935:0:22721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891c124f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22721:1875174015393664:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788305992.274949:0:22721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891c124c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22721:1875174015393792:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788305992.275004:0:22721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556f4 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305992.275260:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994308736 00000100:00100000:0.0:1788305992.275270:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994308736 00010000:00010000:0.0:1788305992.275376:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e60556d8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aed expref: 36 pid: 22721 timeout: 922 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305992.275421:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994308864 00000100:00100000:0.0:1788305992.275426:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994308864 00010000:00010000:0.0:1788305992.275442:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e605561b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08ab5 expref: 37 pid: 23939 timeout: 922 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305992.275461:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:0.0:1788305992.275472:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb363450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+37:2395:x1875173994308736:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305992.275490:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305992.275499:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e60556d8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aed expref: 37 pid: 22721 timeout: 922 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305992.275515:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e60556d8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aed expref: 37 pid: 22721 timeout: 922 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305992.275543:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e60556d8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08aed expref: 37 pid: 22721 timeout: 922 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305992.275573:0:22709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:0.0:1788305992.275578:0:22709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556f4 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305992.275588:0:22709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556f4 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305992.275596:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305992.275686:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb363450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+36:2395:x1875173994308736:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 215us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305992.275695:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:0.0:1788305992.275757:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:0.0:1788305992.275765:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c124fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+35:2395:x1875173994308864:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305992.275774:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305992.275779:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e605561b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08ab5 expref: 35 pid: 23939 timeout: 922 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305992.275788:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e605561b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08ab5 expref: 35 pid: 23939 timeout: 922 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305992.275800:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e605561b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08ab5 expref: 35 pid: 23939 timeout: 922 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305992.275810:0:22709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:0.0:1788305992.275813:0:22709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556f4 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305992.275834:0:22709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556f4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305992.275843:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556f4 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305992.275871:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305992.275894:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c124fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+34:2395:x1875173994308864:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 130us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305992.275900:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 18 00010000:00010000:1.0:1788305992.276266:0:22721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556f4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.276325:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556f4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305992.276352:0:22721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1788305992.276554:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181683000/0x4a426866e60556ed lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08afb expref: 35 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.276575:0:22721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556f4 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08afb expref: 34 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.276583:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:1.0:1788305992.276586:0:22721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788305992.276589:0:22721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181683a00, rc 0) 00000100:00100000:1.0:1788305992.276639:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+34:18880:x1875173994308608:12345-192.168.202.55@tcp:101:bash.0 Request processed in 17765us (18158us total) trans 12884901912 rc 0/0 00000100:00100000:1.0:1788305992.276647:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00100000:0.0:1788305992.296052:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305992.297663:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994309120 00000100:00100000:1.0:1788305992.297682:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994309120 00000100:00100000:1.0:1788305992.297789:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 51 00000100:00100000:1.0:1788305992.297804:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+34:18880:x1875173994309120:12345-192.168.202.55@tcp:36:bash.0 00010000:00010000:1.0:1788305992.298177:0:22722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de400/0x4a426866e6055702 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.298213:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de400/0x4a426866e6055702 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.298228:0:22722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de400/0x4a426866e6055702 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788305992.298345:0:22722:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:1.0:1788305992.298373:0:22722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff060352 reply state 0000000018d4a60b transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de400/0x4a426866e6055702 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.298586:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de400/0x4a426866e6055702 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.298596:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:1.0:1788305992.298599:0:22722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788305992.298604:0:22722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788305992.298755:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+37:18880:x1875173994309120:12345-192.168.202.55@tcp:36:bash.0 Request processed in 950us (2717us total) trans 12884901914 rc 0/0 00000100:00100000:1.0:1788305992.298764:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 51 00000020:00080000:1.0:1788305992.298770:0:22722:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788305992.316915:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305992.317238:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994309248 00000100:00100000:1.0:1788305992.317251:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994309248 00000100:00100000:1.0:1788305992.317574:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00100000:1.0:1788305992.317588:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c124c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+37:18880:x1875173994309248:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:1.0:1788305992.317638:0:22723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305992.317668:0:22723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055709 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08b02 expref: -99 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.317751:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055709 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b02 expref: 38 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.317788:0:22723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055709 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b02 expref: 38 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.317814:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:1.0:1788305992.317817:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788305992.317822:0:22723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88919d7dea00, rc 0) 00000100:00100000:1.0:1788305992.317954:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c124c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+38:18880:x1875173994309248:12345-192.168.202.55@tcp:101:bash.0 Request processed in 369us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305992.317962:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00100000:3.0:1788305992.350725:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305992.350857:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994309376 00000100:00100000:1.0:1788305992.350870:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994309376 00000100:00100000:1.0:1788305992.350948:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 53 00000100:00100000:1.0:1788305992.350960:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c124e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+38:18880:x1875173994309376:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:1.0:1788305992.350989:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305992.351018:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e6055710 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08b09 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.351152:0:22722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e6055717 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.351171:0:22722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556f4 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08afb expref: 39 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.351180:0:22722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e6055717 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.351227:0:22722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556f4 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08afb expref: 39 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.351260:0:22722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556f4 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08afb expref: 39 pid: 22721 timeout: 922 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305992.351328:0:22722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891c124a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22722:1875174015393920:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788305992.351439:0:22722:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918ed65900 going to sleep for 11 seconds 00000100:00100000:1.0:1788305992.356116:0:22722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891c124a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22722:1875174015393920:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788305992.356164:0:22722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e6055717 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305992.360656:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305992.360777:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994309504 00000100:00100000:0.0:1788305992.360790:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994309504 00010000:00010000:0.0:1788305992.360844:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556f4 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08afb expref: 40 pid: 22721 timeout: 922 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305992.360896:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:0.0:1788305992.360906:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c124ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+40:2396:x1875173994309504:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305992.360929:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305992.360938:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556f4 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08afb expref: 40 pid: 22721 timeout: 922 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305992.360954:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556f4 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08afb expref: 40 pid: 22721 timeout: 922 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305992.360981:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e60556f4 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08afb expref: 40 pid: 22721 timeout: 922 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305992.361026:0:22709:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:0.0:1788305992.361032:0:22709:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e6055717 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305992.361043:0:22709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e6055717 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305992.361052:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e6055717 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305992.361093:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305992.361165:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c124ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+39:2396:x1875173994309504:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 259us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305992.361173:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 19 00010000:00010000:2.0:1788305992.361249:0:22722:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e6055717 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.361259:0:22722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e6055717 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305992.361371:0:22722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788305992.361376:0:22722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788305992.361405:0:22722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e6055717 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.361453:0:22722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e6055710 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b09 expref: 39 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.361471:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e6055717 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b09 expref: 38 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.361479:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:2.0:1788305992.361482:0:22722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305992.361484:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88919d7df800, rc 0) 00000100:00100000:2.0:1788305992.361511:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c124e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+38:18880:x1875173994309376:12345-192.168.202.55@tcp:101:bash.0 Request processed in 10556us (10805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305992.361518:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 53 00000100:00100000:0.0:1788305992.367587:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305992.367696:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994309760 00000100:00100000:2.0:1788305992.367710:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994309760 00000100:00100000:2.0:1788305992.367796:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:2.0:1788305992.367810:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+38:18880:x1875173994309760:12345-192.168.202.55@tcp:103:bash.0 00010000:00010000:2.0:1788305992.367832:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788305992.367871:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055709 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b02 expref: 38 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.367905:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e6055717 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b09 expref: 37 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.367918:0:22708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:2.0:1788305992.367924:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305992.368010:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+36:18880:x1875173994309760:12345-192.168.202.55@tcp:103:bash.0 Request processed in 203us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305992.368039:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:3.0:1788305992.373629:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305992.374057:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994309888 00000100:00100000:2.0:1788305992.374071:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994309888 00000100:00100000:2.0:1788305992.374239:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 54 00000100:00100000:2.0:1788305992.374252:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c124ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+36:18880:x1875173994309888:12345-192.168.202.55@tcp:58:bash.0 00010000:00010000:2.0:1788305992.374803:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e605571e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.374831:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e605571e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.374846:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e605571e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788305992.376906:0:22721:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305992.376951:0:22721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1788305992.377102:0:22721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1788305992.377243:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c124ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+36:18880:x1875173994309888:12345-192.168.202.55@tcp:58:bash.0 Request processed in 2985us (3632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305992.377256:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 54 00000100:00100000:3.0:1788305992.382636:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305992.383229:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994310016 00000100:00100000:2.0:1788305992.383245:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994310016 00000100:00100000:2.0:1788305992.383580:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 55 00000100:00100000:2.0:1788305992.383597:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c124ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+36:18880:x1875173994310016:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788305992.383636:0:23939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305992.383666:0:23939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055725 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08b10 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.383741:0:23939:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e605571e lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.383753:0:23939:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055725 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b10 expref: 37 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.383803:0:23939:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e605571e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.383820:0:23939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055725 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b10 expref: 37 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.383839:0:23939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:2.0:1788305992.383842:0:23939:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788305992.383846:0:23939:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055725 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b10 expref: 37 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.383855:0:23939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183565c00, rc 0) 00000100:00100000:2.0:1788305992.383941:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c124ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+37:18880:x1875173994310016:12345-192.168.202.55@tcp:101:bash.0 Request processed in 349us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305992.383949:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 55 00010000:00010000:3.0:1788305992.405771:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305992.661960:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891c124d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015394304:0@lo:400:kworker.0 00000100:00100000:3.0:1788305992.662066:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305992.662134:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891c124f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015394816:0@lo:400:kworker.0 00000100:00100000:3.0:1788305992.662160:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305992.662177:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015395328:0@lo:400:kworker.0 00000100:00100000:3.0:1788305992.662205:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305992.662236:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788305992.662242:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891c124f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015394176:0@lo:400:kworker.0 00000100:00100000:3.0:1788305992.662269:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305992.662323:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891c124c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015394688:0@lo:400:kworker.0 00000100:00100000:3.0:1788305992.662347:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305992.662364:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d77b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015395200:0@lo:400:kworker.0 00000100:00100000:2.0:1788305992.662579:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015394304 00000100:00100000:2.0:1788305992.662590:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015394304 00000100:00100000:2.0:1788305992.662673:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015394816 00000100:00100000:2.0:1788305992.662677:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015394816 00000100:00100000:2.0:1788305992.662711:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788305992.662723:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015394304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305992.662804:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015394304:12345-0@lo:400:kworker.0 Request processed in 83us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305992.662813:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788305992.662833:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788305992.662840:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015394816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305992.662883:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015394816:12345-0@lo:400:kworker.0 Request processed in 43us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305992.662889:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788305992.662943:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015394176 00000100:00100000:2.0:1788305992.662947:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015394176 00000100:00100000:2.0:1788305992.662977:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015394688 00000100:00100000:2.0:1788305992.662980:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015394688 00000100:00100000:2.0:1788305992.662994:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788305992.663001:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d77bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015394176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305992.663037:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d77bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015394176:12345-0@lo:400:kworker.0 Request processed in 37us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305992.663044:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788305992.663056:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788305992.663062:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015394688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305992.663095:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015394688:12345-0@lo:400:kworker.0 Request processed in 33us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305992.663101:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788305992.663483:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305992.663548:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891c124d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015394304:0@lo:400:kworker.0 00000100:00100000:3.0:1788305992.663564:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891c124f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015394816:0@lo:400:kworker.0 00000100:00100000:3.0:1788305992.663595:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891c124f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015394176:0@lo:400:kworker.0 00000100:00100000:3.0:1788305992.663603:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891c124c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015394688:0@lo:400:kworker.0 00000100:00100000:0.0:1788305992.664321:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891c124dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4402ecd-e8a2-4271-82d7-771a7bb97982:3648:1875174015394048:0@lo:400:kworker.0 00000100:00100000:0.0:1788305992.664423:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305992.664469:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891c124f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015394560:0@lo:400:kworker.0 00000100:00100000:0.0:1788305992.664501:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305992.664525:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d77aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015395072:0@lo:400:kworker.0 00000100:00100000:0.0:1788305992.664547:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305992.664564:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d779f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015395584:0@lo:400:kworker.0 00000100:00100000:0.0:1788305992.664586:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305992.664607:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788305992.664625:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891c124e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015394432:0@lo:400:kworker.0 00000100:00100000:0.0:1788305992.664653:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305992.664686:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891c124ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015394944:0@lo:400:kworker.0 00000100:00100000:0.0:1788305992.664711:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305992.664729:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015395456:0@lo:400:kworker.0 00000100:00100000:0.0:1788305992.664767:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305992.664802:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015394432 00000100:00100000:0.0:1788305992.664809:0:24232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015394432 00000100:00100000:0.0:1788305992.664858:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015394944 00000100:00100000:0.0:1788305992.664861:0:24232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015394944 00000100:00100000:0.0:1788305992.664900:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788305992.664910:0:24232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015394432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305992.664969:0:24232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015394432:12345-0@lo:400:kworker.0 Request processed in 59us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305992.664977:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788305992.664996:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788305992.665003:0:24232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015394944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305992.665029:0:24232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015394944:12345-0@lo:400:kworker.0 Request processed in 28us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305992.665036:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788305992.665054:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305992.665060:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305992.665156:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891c124e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015394432:0@lo:400:kworker.0 00000100:00100000:0.0:1788305992.665169:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891c124ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015394944:0@lo:400:kworker.0 00000100:00100000:0.0:1788305992.665200:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015395328 00000100:00100000:0.0:1788305992.665205:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015395328 00000100:00080000:0.0:1788305992.665221:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788305992.665242:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015395200 00000100:00100000:0.0:1788305992.665245:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015395200 00000100:00080000:0.0:1788305992.665267:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305992.665316:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015394560 00000100:00100000:0.0:1788305992.665320:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015394560 00000100:00100000:0.0:1788305992.665333:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015395072 00000100:00100000:0.0:1788305992.665335:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015395072 00000100:00100000:0.0:1788305992.665345:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015395584 00000100:00100000:0.0:1788305992.665348:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015395584 00000100:00080000:0.0:1788305992.665360:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788305992.665372:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015395456 00000100:00100000:0.0:1788305992.665374:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015395456 00000100:00080000:0.0:1788305992.665385:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305992.665398:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788305992.665405:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015395328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305992.665448:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015395328:12345-0@lo:400:kworker.0 Request processed in 44us (3242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305992.665454:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788305992.665466:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788305992.665472:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d77a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015395200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305992.665503:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d77a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015395200:12345-0@lo:400:kworker.0 Request processed in 31us (2021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305992.665509:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788305992.665521:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788305992.665527:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015394560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305992.665559:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015394560:12345-0@lo:400:kworker.0 Request processed in 33us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305992.665564:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788305992.665588:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891c124f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015394560:0@lo:400:kworker.0 00000100:00100000:0.0:1788305992.665607:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788305992.665635:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015395072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305992.665671:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015395072:12345-0@lo:400:kworker.0 Request processed in 38us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305992.665676:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788305992.665700:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d77aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015395072:0@lo:400:kworker.0 00000100:00100000:0.0:1788305992.665719:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788305992.665726:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908202dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015395584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305992.665758:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908202dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015395584:12345-0@lo:400:kworker.0 Request processed in 33us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305992.665764:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1788305992.665791:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88919d779f80 x1875174015395584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788306008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305992.665803:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d779f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015395584:0@lo:400:kworker.0 00000100:00100000:0.0:1788305992.665823:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788305992.665829:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015395456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305992.665863:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015395456:12345-0@lo:400:kworker.0 Request processed in 34us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305992.665869:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788305992.665892:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015395456:0@lo:400:kworker.0 00000100:00100000:3.0:1788305992.666228:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d77b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015395200:0@lo:400:kworker.0 00010000:00080000:3.0:1788305992.666244:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88919d779180 x1875174015395328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788306008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305992.666254:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015395328:0@lo:400:kworker.0 00000100:00100000:1.0:1788305992.666923:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015394048 00000100:00100000:1.0:1788305992.666934:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015394048 00000100:00100000:1.0:1788305992.666984:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788305992.666993:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908309a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:3648:x1875174015394048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305992.667061:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908309a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4402ecd-e8a2-4271-82d7-771a7bb97982+24:3648:x1875174015394048:12345-0@lo:400:kworker.0 Request processed in 70us (2639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305992.667067:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788305992.667186:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891c124dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4402ecd-e8a2-4271-82d7-771a7bb97982:3648:1875174015394048:0@lo:400:kworker.0 00000100:00100000:3.0:1788305992.667846:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305992.667867:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015395712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305992.667920:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305992.667991:0:24234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015395712 00000100:00100000:3.0:1788305992.667997:0:24234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015395712 00000100:00100000:3.0:1788305992.668043:0:24234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788305992.668051:0:24234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d77b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015395712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305992.668084:0:24234:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788305992.670163:0:24234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d77b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015395712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2100us (2230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305992.670180:0:24234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788305992.672700:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305992.672742:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015395840:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788305992.672839:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305992.674359:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015395840 00000100:00100000:3.0:1788305992.674389:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015395840 00000100:00100000:3.0:1788305992.674496:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788305992.674512:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c124a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015395840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788305992.674548:0:24235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788305992.674671:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c124a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015395840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 162us (1831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305992.674679:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788305992.675018:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015395840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305992.678851:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015395712:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788305992.790503:0:22756:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788305992.790518:0:22756:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788305992.790602:0:22756:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788305992.790629:0:22756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788305992.790849:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22756:1875174015395968:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788305992.790986:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891baf659c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305992.794822:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22756:1875174015395968:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788305992.796265:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305992.806555:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994310144 00000100:00100000:0.0:1788305992.806579:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994310144 00000100:00100000:0.0:1788305992.806685:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 56 00000100:00100000:0.0:1788305992.806699:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d77ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+37:18881:x1875173994310144:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788305992.815889:0:23939:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788305992.816146:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d77ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+37:18881:x1875173994310144:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 9442us (19885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305992.816162:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 56 00000100:00100000:3.0:1788305992.821862:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305992.822664:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994310272 00000100:00100000:1.0:1788305992.822680:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994310272 00000100:00100000:1.0:1788305992.822762:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 57 00000100:00100000:1.0:1788305992.822793:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+37:18881:x1875173994310272:12345-192.168.202.55@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788305992.822892:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e605572c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.822913:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e605572c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.822926:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e605572c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.822942:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055733 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.822949:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055733 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.822956:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055733 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.822981:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e605573a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.822989:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e605573a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.822995:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e605573a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305992.823053:0:22723:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788305992.823058:0:22723:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788305992.823075:0:22723:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e605573a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.823107:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e605572c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.823114:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e605572c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.823122:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e605572c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.823128:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7df800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305992.823133:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e605572c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.823141:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e605572c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.823156:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8891c20f9400) 00010000:00010000:1.0:1788305992.823159:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305992.823164:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e605572c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.823169:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df800/0x4a426866e605572c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.823184:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055733 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.823190:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055733 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.823196:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055733 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.823207:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7dea00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305992.823210:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055733 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.823216:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055733 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.823225:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8891bb166f00) 00010000:00010000:1.0:1788305992.823227:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305992.823230:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055733 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.823236:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dea00/0x4a426866e6055733 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.823252:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e605573a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.823259:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e605573a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.823264:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e605573a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.823269:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7de600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305992.823272:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e605573a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.823329:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e605573a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.823347:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:1.0:1788305992.823349:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305992.823352:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e605573a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.823358:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de600/0x4a426866e605573a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305992.823700:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+37:18881:x1875173994310272:12345-192.168.202.55@tcp:34:lhsmtool_posix.0 Request processed in 908us (1852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305992.823709:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 57 00000100:00100000:0.0:1788305992.826585:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305992.827258:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994310528 00000100:00100000:1.0:1788305992.827311:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994310528 00000100:00100000:1.0:1788305992.827413:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 58 00000100:00100000:1.0:1788305992.827426:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+37:18881:x1875173994310528:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788305992.827457:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305992.827485:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e6055741 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08b17 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.827672:0:22722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e6055748 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.827692:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e6055748 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.827706:0:22722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e6055748 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305992.827721:0:22722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788305992.827854:0:22722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e6055748 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.827863:0:22722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e6055748 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.827869:0:22722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e6055748 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.827876:0:22722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88918390e600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305992.827881:0:22722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e6055748 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.827889:0:22722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e6055748 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.827907:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:1.0:1788305992.827911:0:22722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788305992.827918:0:22722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e6055748 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.827925:0:22722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e6055748 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.829225:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e6055741 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b17 expref: 39 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.829254:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8891c20f9400) 00010000:00010000:1.0:1788305992.829256:0:22722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788305992.829265:0:22722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7df000/0x4a426866e6055741 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b17 expref: 39 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.829332:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88919d7df000, rc 0) 00000100:00100000:1.0:1788305992.829942:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+38:18881:x1875173994310528:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 2514us (3369us total) trans 12884901915 rc 301/301 00000100:00100000:1.0:1788305992.829953:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 58 00000100:00100000:3.0:1788305992.840340:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305992.840514:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994310656 00000100:00100000:1.0:1788305992.840529:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994310656 00000100:00100000:1.0:1788305992.840621:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 59 00000100:00100000:1.0:1788305992.840634:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+38:18881:x1875173994310656:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788305992.840689:0:22723:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788305992.840858:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+38:18881:x1875173994310656:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 226us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305992.840866:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 59 00000100:00100000:3.0:1788305992.854649:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305992.854912:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994310912 00000100:00100000:2.0:1788305992.854928:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994310912 00000100:00100000:2.0:1788305992.855013:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 60 00000100:00100000:2.0:1788305992.855026:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+38:18881:x1875173994310912:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305992.855058:0:23939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305992.855104:0:23939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e6055756 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08b1e expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788305992.856675:0:23939:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =59 00000004:00080000:2.0:1788305992.856693:0:23939:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+59 in llog 00000004:00080000:2.0:1788305992.856724:0:23939:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:2.0:1788305992.856957:0:23939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564200/0x4a426866e605575d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.856977:0:23939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183564200/0x4a426866e605575d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.856990:0:23939:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183564200/0x4a426866e605575d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.857076:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e6055756 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b1e expref: 41 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.859702:0:23939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564200/0x4a426866e605575d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b1e expref: 40 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.859767:0:23939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8891c20f9600) 00010000:00010000:2.0:1788305992.859770:0:23939:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305992.859774:0:23939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183564200, rc 0) 00000100:00100000:2.0:1788305992.859892:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+40:18881:x1875173994310912:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 4867us (5258us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1788305992.859904:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 60 00000100:00100000:0.0:1788305992.867844:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305992.869991:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994311168 00000100:00100000:1.0:1788305992.870012:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994311168 00000100:00100000:1.0:1788305992.870322:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 61 00000100:00100000:1.0:1788305992.870336:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+40:18881:x1875173994311168:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788305992.870426:0:22723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305992.870468:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183564200/0x4a426866e605575d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b1e expref: 40 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.870493:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8891c20f9600) 00010000:00010000:1.0:1788305992.870509:0:22723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305992.870543:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e605576b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.870588:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e605576b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.870600:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e605576b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.870628:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88918390ec00/0x4a426866e6055772 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x595fecd8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.870635:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88918390ec00/0x4a426866e6055772 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x595fecd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.870641:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88918390ec00/0x4a426866e6055772 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x595fecd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.870702:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e605576b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.870710:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e605576b lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.870717:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e605576b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.870724:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88918390e600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305992.870799:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e605576b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.870809:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e605576b lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.870819:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8891885c8100) 00010000:00010000:1.0:1788305992.870828:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305992.870833:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e605576b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.870839:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e605576b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.870852:0:22723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88918390ec00/0x4a426866e6055772 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x595fecd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.870858:0:22723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88918390ec00/0x4a426866e6055772 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x595fecd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.870863:0:22723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88918390ec00/0x4a426866e6055772 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x595fecd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.870868:0:22723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88918390ec00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305992.870871:0:22723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88918390ec00/0x4a426866e6055772 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x595fecd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.870878:0:22723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88918390ec00/0x4a426866e6055772 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x595fecd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.870885:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x595fecd8 (ffff8891bb166f00) 00010000:00010000:1.0:1788305992.870887:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305992.870890:0:22723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88918390ec00/0x4a426866e6055772 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x595fecd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.870895:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88918390ec00/0x4a426866e6055772 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x595fecd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305992.871015:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+39:18881:x1875173994311168:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 681us (3186us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788305992.871029:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 61 00000100:00100000:3.0:1788305992.878842:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305992.878956:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994311296 00000100:00100000:1.0:1788305992.878969:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994311296 00000100:00100000:1.0:1788305992.879049:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 62 00000100:00100000:1.0:1788305992.879063:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+39:18881:x1875173994311296:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788305992.879526:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305992.879563:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88918390ec00/0x4a426866e6055779 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08b25 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.879631:0:22722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e6055780 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.879649:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e6055780 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.879663:0:22722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e6055780 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.879923:0:22722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88918390ec00/0x4a426866e6055779 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b25 expref: 41 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.879946:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e600/0x4a426866e6055780 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b25 expref: 40 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305992.879956:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8891bb166f00) 00010000:00010000:1.0:1788305992.879959:0:22722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788305992.879963:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88918390e600, rc 0) 00000100:00100000:1.0:1788305992.880107:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+40:18881:x1875173994311296:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 1047us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305992.880124:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 62 00000100:00100000:0.0:1788305992.893916:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305992.894297:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994311552 00000100:00100000:2.0:1788305992.894312:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994311552 00000100:00100000:2.0:1788305992.894402:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 63 00000100:00100000:2.0:1788305992.894415:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+40:18881:x1875173994311552:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788305992.894536:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e6055787 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.894560:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e6055787 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.894575:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e6055787 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788305992.894838:0:22721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:2.0:1788305992.894850:0:22721:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822985574269ns, next at 823985571257ns, rc = 0 00000004:00010000:2.0:1788305992.894917:0:22721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b04b14c reply state 00000000d41ade6e transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e6055787 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.894934:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e6055787 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.894942:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8891bb166f00) 00010000:00010000:2.0:1788305992.894965:0:22721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788305992.894971:0:22721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788305992.895586:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+42:18881:x1875173994311552:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 1168us (1680us total) trans 12884901917 rc 0/0 00000100:00100000:2.0:1788305992.895597:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 63 00000100:00100000:0.0:1788305992.903109:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305992.903532:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994311680 00000100:00100000:2.0:1788305992.903547:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994311680 00000100:00100000:2.0:1788305992.903642:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 64 00000100:00100000:2.0:1788305992.903654:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+42:18881:x1875173994311680:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305992.903689:0:23939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305992.903719:0:23939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e605578e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08b2c expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.903812:0:23939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e605578e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b2c expref: 43 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.903830:0:23939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e605578e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b2c expref: 43 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.903853:0:23939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8891bb166f00) 00010000:00010000:2.0:1788305992.903856:0:23939:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788305992.903861:0:23939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183564000, rc 0) 00000100:00100000:2.0:1788305992.903942:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+43:18881:x1875173994311680:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 290us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305992.903951:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 64 00000100:00100000:3.0:1788305992.913699:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305992.913887:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994311808 00000100:00100000:0.0:1788305992.913900:0:24232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994311808 00000100:00100000:0.0:1788305992.914002:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00100000:0.0:1788305992.914014:0:24232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d779880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+5:2395:x1875173994311808:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788305992.914397:0:24232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d779880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:2395:x1875173994311808:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 Request processed in 385us (715us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1788305992.914407:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00080000:2.0:1788305992.917926:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305992.918434:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305992.918539:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994312064 00000100:00100000:1.0:1788305992.918553:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994312064 00000100:00100000:1.0:1788305992.918641:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:1.0:1788305992.918654:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+43:18881:x1875173994312064:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788305992.918975:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+44:18881:x1875173994312064:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 322us (549us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1788305992.918985:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:3.0:1788305992.923531:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305992.923678:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994312320 00000100:00100000:2.0:1788305992.923692:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994312320 00000100:00100000:2.0:1788305992.923792:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 65 00000100:00100000:2.0:1788305992.923805:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d77a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+44:18881:x1875173994312320:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788305992.923960:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d77a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+44:18881:x1875173994312320:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 157us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305992.923968:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 65 00000100:00100000:0.0:1788305992.932047:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305992.932774:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994312448 00000100:00100000:2.0:1788305992.932792:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994312448 00000100:00100000:2.0:1788305992.932935:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 66 00000100:00100000:2.0:1788305992.932950:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+44:18881:x1875173994312448:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305992.932983:0:23939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305992.933017:0:23939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183565e00/0x4a426866e6055795 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08b33 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.933180:0:23939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e605579c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.933199:0:23939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e605579c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.933215:0:23939:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e605579c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305992.933316:0:23939:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788305992.933346:0:23939:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e605579c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.933388:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183565e00/0x4a426866e6055795 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b33 expref: 46 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.933428:0:23939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e605579c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b33 expref: 45 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.933438:0:23939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8891bb166f00) 00010000:00010000:2.0:1788305992.933441:0:23939:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788305992.933445:0:23939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183565400, rc 0) 00000100:00100000:2.0:1788305992.933535:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+45:18881:x1875173994312448:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 588us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305992.933543:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 66 00000100:00100000:0.0:1788305992.940465:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305992.940688:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994312576 00000100:00100000:3.0:1788305992.940703:0:24231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994312576 00000100:00100000:3.0:1788305992.940787:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:3.0:1788305992.940799:0:24231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:2398:x1875173994312576:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305992.940846:0:24231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305992.940874:0:24231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ec48312/0x4a426866e60557a3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08b3a expref: -99 pid: 24231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788305992.940909:0:24231:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a976248, blocks: 0x0 00010000:00010000:3.0:1788305992.940934:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=823s v=(0 0) 00010000:00010000:3.0:1788305992.940940:0:24231:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305992.940953:0:24231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ec48312/0x4a426866e60557a3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b3a expref: 7 pid: 24231 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305992.940978:0:24231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003ec48312/0x4a426866e60557a3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b3a expref: 7 pid: 24231 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305992.940994:0:24231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181683200, rc 0) 00000100:00100000:3.0:1788305992.941073:0:24231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+7:2398:x1875173994312576:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 275us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305992.941101:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:3.0:1788305992.946863:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305992.947006:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994312832 00000100:00100000:2.0:1788305992.947022:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994312832 00000100:00100000:2.0:1788305992.947118:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 67 00000100:00100000:2.0:1788305992.947132:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+45:18881:x1875173994312832:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788305992.947811:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+45:18881:x1875173994312832:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 676us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305992.947821:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 67 00000100:00100000:3.0:1788305992.951985:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305992.952120:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994312960 00000100:00100000:1.0:1788305992.952133:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994312960 00000100:00100000:1.0:1788305992.952210:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 68 00000100:00100000:1.0:1788305992.952223:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+45:18881:x1875173994312960:12345-192.168.202.55@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788305992.955874:0:22702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:1.0:1788305992.955902:0:22702:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1788305992.956087:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6055565 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956109:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6055565 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956119:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6055565 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956126:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8a00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305992.956163:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6055565 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956173:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6055565 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956199:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8891885c8b00) 00010000:00010000:2.0:1788305992.956203:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305992.956210:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6055565 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956215:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6055565 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956246:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605556c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956253:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605556c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956259:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605556c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956264:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305992.956267:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605556c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956272:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605556c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956367:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8891885c8100) 00010000:00010000:2.0:1788305992.956379:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305992.956390:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605556c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956397:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605556c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956414:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e6055614 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956421:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e6055614 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956427:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e6055614 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956431:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea200 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305992.956435:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e6055614 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956442:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e6055614 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956450:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8891885c8500) 00010000:00010000:2.0:1788305992.956453:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305992.956456:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e6055614 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956462:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e6055614 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956479:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e6055699 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956496:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e6055699 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956503:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e6055699 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956508:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183564600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305992.956511:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e6055699 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956517:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e6055699 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956525:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:2.0:1788305992.956527:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305992.956530:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e6055699 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956535:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e6055699 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956546:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60556bc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956551:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60556bc lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956556:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60556bc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956559:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7de800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305992.956570:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60556bc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956575:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60556bc lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956582:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:2.0:1788305992.956584:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305992.956586:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60556bc lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956592:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de800/0x4a426866e60556bc lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956606:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de400/0x4a426866e6055702 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956622:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de400/0x4a426866e6055702 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956626:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de400/0x4a426866e6055702 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956630:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88919d7de400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305992.956633:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de400/0x4a426866e6055702 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956637:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de400/0x4a426866e6055702 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956644:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:2.0:1788305992.956646:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305992.956654:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de400/0x4a426866e6055702 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956659:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7de400/0x4a426866e6055702 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956671:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e6055787 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956676:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e6055787 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956681:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e6055787 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956686:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183564400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305992.956688:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e6055787 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956694:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e6055787 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956701:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8891bb166f00) 00010000:00010000:2.0:1788305992.956703:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788305992.956705:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e6055787 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.956710:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e6055787 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305992.961785:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000001:00080000:1.0:1788305992.962514:0:22702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:0.0:1788305992.962847:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+14:18881:x1875173994312960:12345-192.168.202.55@tcp:44:lhsmtool_posix.0 Request processed in 10614us (10866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305992.962864:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 68 00000100:00100000:2.0:1788305992.973499:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88919d117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015396096:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788305992.973641:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305992.973875:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015396096 00000100:00100000:0.0:1788305992.973887:0:24232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015396096 00000100:00100000:0.0:1788305992.973965:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788305992.973976:0:24232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015396096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788305992.974188:0:24232:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788305992.974192:0:24232:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788305992.974195:0:24232:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788305992.974197:0:24232:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788305992 -> 1788305992 00002000:00010000:0.0:1788305992.974200:0:24232:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788305992.974262:0:24232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875174015396096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 287us (620us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788305992.974319:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:2.0:1788305992.975364:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88919d117100/2, rc 0, transno 12884901892 00010000:00010000:3.0:1788305992.975726:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60555b9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305992.975745:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60555b9 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305992.975754:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60555b9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305992.975780:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9e00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305992.975786:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60555b9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305992.975795:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60555b9 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305992.975819:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8891885c8100) 00010000:00010000:3.0:1788305992.975822:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788305992.975828:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60555b9 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305992.975835:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60555b9 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305992.975967:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88919d117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015396096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788305992.976344:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305992.976544:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994313088 00000100:00100000:3.0:1788305992.976553:0:24231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994313088 00000100:00100000:3.0:1788305992.976876:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 26 00000100:00100000:3.0:1788305992.976890:0:24231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d114e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+7:2395:x1875173994313088:12345-192.168.202.55@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788305992.977102:0:24231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d114e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+7:2395:x1875173994313088:12345-192.168.202.55@tcp:16:lhsmtool_posix.0 Request processed in 215us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305992.977110:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 26 00000100:00100000:1.0:1788305992.986717:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305992.986808:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994313344 00000100:00100000:2.0:1788305992.986823:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994313344 00000100:00100000:2.0:1788305992.986898:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:2.0:1788305992.986909:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c124ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+14:18881:x1875173994313344:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788305992.986985:0:22723:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305992.987023:0:22723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e605579c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b33 expref: 14 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.987046:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8891bb166f00) 00010000:00010000:2.0:1788305992.987052:0:22723:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305992.987102:0:22723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565e00/0x4a426866e60557aa lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.987120:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183565e00/0x4a426866e60557aa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.987133:0:22723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183565e00/0x4a426866e60557aa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788305992.987754:0:22723:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d272b391 reply state 000000007ad61aff transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff889183565e00/0x4a426866e60557aa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.987774:0:22723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183565e00/0x4a426866e60557aa lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22723 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305992.987780:0:22723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8891bb166f00) 00010000:00010000:2.0:1788305992.987783:0:22723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788305992.987804:0:22723:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788305992.988127:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c124ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+15:18881:x1875173994313344:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 1215us (1421us total) trans 12884901919 rc 0/0 00000100:00100000:2.0:1788305992.988136:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:2.0:1788305993.010441:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305993.013756:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994313472 00000100:00100000:0.0:1788305993.013783:0:24232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994313472 00000100:00100000:1.0:1788305993.020235:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 27 00000100:00100000:1.0:1788305993.020256:0:24232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+7:18881:x1875173994313472:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788305993.020319:0:24232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305993.020349:0:24232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4d17f4c/0x4a426866e60557b1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08b41 expref: -99 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.020747:0:24232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003ec48312/0x4a426866e60557a3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b3a expref: 8 pid: 24231 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.020786:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305993.020792:0:24232:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305993.020798:0:24232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4d17f4c/0x4a426866e60557b1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b41 expref: 8 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.020850:0:24232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003ec48312/0x4a426866e60557a3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b3a expref: 8 pid: 24231 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.020868:0:24232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003ec48312/0x4a426866e60557a3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b3a expref: 8 pid: 24231 timeout: 923 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305993.020887:0:24232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891c1248e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24232:1875174015396224:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788305993.021020:0:24232:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af2706c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305993.026134:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305993.026563:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994313600 00000100:00100000:0.0:1788305993.026578:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994313600 00010000:00010000:0.0:1788305993.026651:0:22707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003ec48312/0x4a426866e60557a3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b3a expref: 9 pid: 24231 timeout: 923 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305993.026713:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:0.0:1788305993.026727:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+9:2395:x1875173994313600:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305993.026746:0:22707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305993.026777:0:22707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003ec48312/0x4a426866e60557a3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b3a expref: 9 pid: 24231 timeout: 923 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305993.026793:0:22707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003ec48312/0x4a426866e60557a3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b3a expref: 9 pid: 24231 timeout: 923 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305993.026826:0:22707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305993.026831:0:22707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305993.026840:0:22707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4d17f4c/0x4a426866e60557b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b41 expref: 9 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305993.026852:0:22707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4d17f4c/0x4a426866e60557b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b41 expref: 9 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305993.026935:0:22707:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f4d17f4c/0x4a426866e60557b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b41 expref: 9 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305993.026952:0:22707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb35880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:22707:1875174015396352:192.168.202.55@tcp:105: 00000100:00100000:0.0:1788305993.027067:0:22707:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918ed1ce40 going to sleep for 11 seconds 00010000:00010000:1.0:1788305993.028783:0:24232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ec48312/0x4a426866e60557a3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b3a expref: 9 pid: 24231 timeout: 923 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305993.028814:0:24232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891c1248e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24232:1875174015396224:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788305993.028857:0:24232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f4d17f4c/0x4a426866e60557b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b41 expref: 8 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.028875:0:24232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88918390e000, rc 0) 00000100:00100000:1.0:1788305993.028964:0:24232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+8:18881:x1875173994313472:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 8712us (18701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305993.029000:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 27 00000100:00100000:2.0:1788305993.039943:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305993.041164:0:22707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb35880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:22707:1875174015396352:192.168.202.55@tcp:105: 00010000:00010000:0.0:1788305993.041205:0:22707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305993.041362:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+7:2395:x1875173994313600:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 14635us (15243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305993.041388:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:3.0:1788305993.042506:0:24231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994313728 00000100:00100000:3.0:1788305993.042525:0:24231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994313728 00000100:00100000:3.0:1788305993.042657:0:24231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00100000:3.0:1788305993.042670:0:24231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+7:2395:x1875173994313728:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788305993.042899:0:24231:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788305993.042923:0:24231:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788305991 00002000:00010000:3.0:1788305993.042926:0:24231:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788305989 00002000:00010000:3.0:1788305993.042928:0:24231:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788305992 -> 1788305991 00002000:00010000:3.0:1788305993.042930:0:24231:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788305993.042992:0:24231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+8:2395:x1875173994313728:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 Request processed in 324us (3064us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788305993.042999:0:24231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00100000:0.0:1788305993.052088:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305993.052354:0:24233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994313856 00000100:00100000:1.0:1788305993.052368:0:24233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994313856 00000100:00100000:1.0:1788305993.052451:0:24233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 29 00000100:00100000:1.0:1788305993.052465:0:24233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+8:2397:x1875173994313856:12345-192.168.202.55@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788305993.052534:0:24233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000061676a42/0x4a426866e60557b8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.052562:0:24233:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4d17f4c/0x4a426866e60557b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b41 expref: 8 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.052572:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305993.052577:0:24233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788305993.052582:0:24233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061676a42/0x4a426866e60557b8 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.052644:0:24233:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f4d17f4c/0x4a426866e60557b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b41 expref: 8 pid: 24232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.052660:0:24233:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f4d17f4c/0x4a426866e60557b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b41 expref: 8 pid: 24232 timeout: 923 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305993.052678:0:24233:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891c1248e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24233:1875174015396480:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788305993.052792:0:24233:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af2706c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305993.057041:0:24233:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891c1248e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24233:1875174015396480:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788305993.057106:0:24233:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061676a42/0x4a426866e60557b8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305993.058922:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305993.059520:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994313984 00000100:00100000:1.0:1788305993.059556:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994313984 00010000:00010000:1.0:1788305993.059621:0:22709:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f4d17f4c/0x4a426866e60557b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b41 expref: 9 pid: 24232 timeout: 923 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305993.059681:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:1.0:1788305993.059693:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+9:2395:x1875173994313984:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305993.059717:0:22709:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305993.059746:0:22709:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f4d17f4c/0x4a426866e60557b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b41 expref: 9 pid: 24232 timeout: 923 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.059763:0:22709:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f4d17f4c/0x4a426866e60557b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b41 expref: 9 pid: 24232 timeout: 923 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.059792:0:22709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4d17f4c/0x4a426866e60557b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b41 expref: 9 pid: 24232 timeout: 923 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.059815:0:22709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788305993.059821:0:22709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788305993.059828:0:22709:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061676a42/0x4a426866e60557b8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.059839:0:22709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061676a42/0x4a426866e60557b8 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.059879:0:22709:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305993.060022:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+8:2395:x1875173994313984:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 331us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305993.060039:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 21 00010000:00010000:0.0:1788305993.060133:0:24233:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061676a42/0x4a426866e60557b8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305993.060153:0:24233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061676a42/0x4a426866e60557b8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305993.060180:0:24233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000061676a42/0x4a426866e60557b8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305993.060197:0:24233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061676a42/0x4a426866e60557b8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305993.060206:0:24233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061676a42/0x4a426866e60557b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305993.060213:0:24233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88918390f400 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305993.060217:0:24233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061676a42/0x4a426866e60557b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305993.060226:0:24233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061676a42/0x4a426866e60557b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305993.060240:0:24233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061676a42/0x4a426866e60557b8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305993.060247:0:24233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061676a42/0x4a426866e60557b8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305993.060385:0:24233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+7:2397:x1875173994313856:12345-192.168.202.55@tcp:1:lhsmtool_posix.0 Request processed in 7922us (8323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305993.060394:0:24233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 29 00000100:00100000:1.0:1788305993.065955:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305993.066046:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994314240 00000100:00100000:2.0:1788305993.066060:0:23939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994314240 00000100:00080000:0.0:1788305993.066502:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305993.066599:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 70 00000100:00100000:2.0:1788305993.066624:0:23939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c1248a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+15:18881:x1875173994314240:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788305993.066744:0:23939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557bf lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.066766:0:23939:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dee00/0x4a426866e6055692 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08adf expref: 15 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.066776:0:23939:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557bf lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.066826:0:23939:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dee00/0x4a426866e6055692 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08adf expref: 15 pid: 22723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.066843:0:23939:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dee00/0x4a426866e6055692 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08adf expref: 15 pid: 22723 timeout: 923 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305993.066859:0:23939:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23939:1875174015396608:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788305993.067019:0:23939:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891baf65480 going to sleep for 11 seconds 00000100:00100000:0.0:1788305993.073737:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305993.073848:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994314368 00000100:00100000:1.0:1788305993.073862:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994314368 00010000:00010000:1.0:1788305993.073915:0:22707:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dee00/0x4a426866e6055692 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08adf expref: 16 pid: 22723 timeout: 923 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305993.073964:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:1.0:1788305993.073975:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+16:2396:x1875173994314368:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305993.073995:0:22707:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305993.074003:0:22707:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dee00/0x4a426866e6055692 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08adf expref: 16 pid: 22723 timeout: 923 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.074018:0:22707:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dee00/0x4a426866e6055692 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08adf expref: 16 pid: 22723 timeout: 923 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.074048:0:22707:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:1.0:1788305993.074054:0:22707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055725 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b10 expref: 16 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.074065:0:22707:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557bf lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.074093:0:22707:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.074101:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557bf lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.074143:0:22707:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305993.074232:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+16:2396:x1875173994314368:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 258us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305993.074240:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 22 00010000:00010000:2.0:1788305993.075921:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88919d7dee00/0x4a426866e6055692 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08adf expref: 15 pid: 22723 timeout: 923 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305993.075953:0:23939:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23939:1875174015396608:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788305993.075993:0:23939:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.076005:0:23939:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.076012:0:23939:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.076644:0:23939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e60557c6 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.076669:0:23939:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e605578e lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b2c expref: 15 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.076681:0:23939:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e60557c6 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.076732:0:23939:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e605578e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b2c expref: 15 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.076753:0:23939:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e605578e lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b2c expref: 15 pid: 23939 timeout: 923 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305993.076769:0:23939:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23939:1875174015396736:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788305993.077064:0:23939:0:(client.c:2715:ptlrpc_set_wait()) set ffff889082568c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305993.090815:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305993.091008:0:23939:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23939:1875174015396736:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788305993.091052:0:23939:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e60557c6 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305993.091582:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994314496 00000100:00100000:3.0:1788305993.091594:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994314496 00010000:00010000:3.0:1788305993.091657:0:22708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e605578e lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b2c expref: 16 pid: 23939 timeout: 923 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305993.091709:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00100000:3.0:1788305993.091721:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb363c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+16:2395:x1875173994314496:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305993.091741:0:22708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305993.091749:0:22708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e605578e lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b2c expref: 16 pid: 23939 timeout: 923 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305993.091764:0:22708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e605578e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b2c expref: 16 pid: 23939 timeout: 923 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305993.091791:0:22708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e605578e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b2c expref: 16 pid: 23939 timeout: 923 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305993.091811:0:22708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8891bb166f00) 00010000:00010000:3.0:1788305993.091817:0:22708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e60557c6 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305993.091845:0:22708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e60557c6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305993.091855:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e60557c6 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305993.091890:0:22708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305993.091968:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb363c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+15:2395:x1875173994314496:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 249us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305993.091977:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 23 00010000:00010000:2.0:1788305993.092561:0:23939:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e60557c6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.092573:0:23939:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e60557c6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788305993.092766:0:23939:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:2.0:1788305993.092928:0:23939:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:2.0:1788305993.092973:0:23939:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:2.0:1788305993.093214:0:23939:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:23939:1875174015396864:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788305993.093628:0:23939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305993.093675:0:23939:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b90accc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305993.093842:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015396864 00000100:00100000:3.0:1788305993.093852:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015396864 00000100:00100000:3.0:1788305993.093918:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788305993.093928:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23939:x1875174015396864:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788305993.094243:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23939:x1875174015396864:12345-0@lo:1000:mdt00_003.0 Request processed in 315us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305993.094252:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788305993.100863:0:23939:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:23939:1875174015396864:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788305993.101740:0:23939:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:1.0:1788305993.101872:0:23939:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891c1248e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:23939:1875174015396992:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788305993.101976:0:23939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305993.106479:0:23939:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfae86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305993.107048:0:23464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015396992 00000100:00100000:3.0:1788305993.107062:0:23464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015396992 00000100:00100000:3.0:1788305993.107616:0:23464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788305993.107632:0:23464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c1249f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:23939:x1875174015396992:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788305993.107927:0:23464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c1249f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:23939:x1875174015396992:12345-0@lo:1000:mdt00_003.0 Request processed in 298us (5949us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1788305993.107936:0:23464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788305993.108046:0:23939:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891c1248e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:23939:1875174015396992:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788305993.108523:0:23939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e60557c6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.108538:0:23939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e60557c6 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.108547:0:23939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e60557c6 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.108554:0:23939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183564600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305993.108560:0:23939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e60557c6 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.108569:0:23939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e60557c6 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.108602:0:23939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8891bb166f00) 00010000:00010000:1.0:1788305993.108615:0:23939:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788305993.108642:0:23939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e60557c6 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.108649:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183564600/0x4a426866e60557c6 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.108697:0:23939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e605571e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.108704:0:23939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e605571e lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.108710:0:23939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e605571e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.108716:0:23939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183565a00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305993.108719:0:23939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e605571e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.108725:0:23939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e605571e lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.108734:0:23939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:1.0:1788305993.108736:0:23939:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788305993.108745:0:23939:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055725 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b10 expref: 18 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.108758:0:23939:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055725 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b10 expref: 18 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.108767:0:23939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055725 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b10 expref: 18 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.108860:0:23939:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff889183565c00/0x4a426866e6055725 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b10 expref: 18 pid: 23939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305993.108878:0:23939:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891c1248380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23939:1875174015397120:192.168.202.55@tcp:105: 00000100:00100000:1.0:1788305993.108989:0:23939:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfae86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305993.121689:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305993.121790:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994314624 00000100:00100000:2.0:1788305993.121803:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994314624 00000100:00100000:2.0:1788305993.121879:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:2.0:1788305993.121892:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+19:18880:x1875173994314624:12345-192.168.202.55@tcp:49:bash.0 00000100:00100000:2.0:1788305993.122096:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+19:18880:x1875173994314624:12345-192.168.202.55@tcp:49:bash.0 Request processed in 195us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305993.122105:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:2.0:1788305993.127618:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305993.127747:0:24697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994314752 00000100:00100000:0.0:1788305993.127764:0:24697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994314752 00000100:00100000:0.0:1788305993.127848:0:24697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:0.0:1788305993.127861:0:24697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+7:18880:x1875173994314752:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788305993.127886:0:24697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305993.127915:0:24697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f67ba84f/0x4a426866e60557cd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08b48 expref: -99 pid: 24697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788305993.127952:0:24697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a976247, atime: 0x6a976245, ctime: 0x6a976247, blocks: 0x0 00010000:00010000:0.0:1788305993.127984:0:24697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=823s v=(0 0) 00010000:00010000:0.0:1788305993.127990:0:24697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305993.128013:0:24697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f67ba84f/0x4a426866e60557cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b48 expref: 8 pid: 24697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305993.128034:0:24697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f67ba84f/0x4a426866e60557cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b48 expref: 8 pid: 24697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305993.128051:0:24697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eba00, rc 0) 00000100:00100000:0.0:1788305993.128148:0:24697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+8:18880:x1875173994314752:12345-192.168.202.55@tcp:101:bash.0 Request processed in 288us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305993.128157:0:24697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:3.0:1788305993.133670:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305993.133917:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994314880 00000100:00100000:2.0:1788305993.133930:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994314880 00000100:00100000:2.0:1788305993.134006:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 71 00000100:00100000:2.0:1788305993.134017:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+19:18880:x1875173994314880:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788305993.134069:0:22721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305993.134118:0:22721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183564200/0x4a426866e60557d4 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08b4f expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.134168:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e60557db lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.134185:0:22721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557bf lrc: 2/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.134194:0:22721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e60557db lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.134217:0:22721:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.134231:0:22721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e60557db lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305993.134843:0:23939:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891c1248380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23939:1875174015397120:192.168.202.55@tcp:105: 00010000:00010000:1.0:1788305993.134872:0:23939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e605571e lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.134882:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183565a00/0x4a426866e605571e lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.135066:0:23939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e60557e2 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.135752:0:23939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e60557e2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.135769:0:23939:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e60557e2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.135782:0:23939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e60557e2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.135789:0:23939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e60557e2 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.135816:0:23939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e60557e2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.135824:0:23939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183564000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305993.135828:0:23939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e60557e2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.135837:0:23939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e60557e2 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.135851:0:23939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:2.0:1788305993.135854:0:23939:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305993.135858:0:23939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e60557e2 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.135864:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e60557e2 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.135877:0:23939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.135884:0:23939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557bf lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.135889:0:23939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557bf lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.135894:0:23939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183564400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305993.135897:0:23939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557bf lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.135914:0:23939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557bf lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.135923:0:23939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:2.0:1788305993.135926:0:23939:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788305993.135929:0:23939:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e60557db lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.135937:0:23939:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e60557db lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.135943:0:23939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e60557db lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.135979:0:23939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557bf lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.135986:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557bf lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 23939 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788305993.136439:0:22756:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788305993.136446:0:22756:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788305993.136466:0:22756:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788305993.136476:0:22756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788305993.137321:0:22721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e60557db lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305993.137355:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e60557db lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305993.137700:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183564200/0x4a426866e60557d4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b4f expref: 21 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305993.137727:0:22721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565400/0x4a426866e60557db lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b4f expref: 20 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305993.137738:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:3.0:1788305993.137741:0:22721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788305993.137745:0:22721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183565400, rc 0) 00000100:00100000:3.0:1788305993.137845:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+20:18880:x1875173994314880:12345-192.168.202.55@tcp:101:bash.0 Request processed in 3827us (4191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305993.137856:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 71 00000100:00100000:3.0:1788305993.142901:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305993.143189:0:23939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c1248a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82e7fd09-0853-4033-81ad-9c2ffd2628a0+19:18881:x1875173994314240:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 76576us (77247us total) trans 12884901924 rc 0/0 00000100:00100000:2.0:1788305993.143206:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 70 00000020:00080000:2.0:1788305993.143215:0:23939:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788305993.148500:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994315136 00000100:00100000:1.0:1788305993.148522:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994315136 00000100:00100000:1.0:1788305993.148616:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:1.0:1788305993.148632:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919d77aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+19:18880:x1875173994315136:12345-192.168.202.55@tcp:35:bash.0 00000001:00080000:1.0:1788305993.149082:0:22724:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00000001:00080000:1.0:1788305993.149232:0:22724:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901926 00000100:00100000:1.0:1788305993.149441:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919d77aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+22:18880:x1875173994315136:12345-192.168.202.55@tcp:35:bash.0 Request processed in 809us (6555us total) trans 12884901927 rc 0/0 00000100:00100000:1.0:1788305993.149451:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 13 00000020:00080000:1.0:1788305993.149457:0:22724:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788305993.165267:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305993.165589:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994315392 00000100:00100000:1.0:1788305993.165603:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994315392 00000100:00100000:1.0:1788305993.165695:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:1.0:1788305993.165708:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+22:18881:x1875173994315392:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788305993.166128:0:22724:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788305993.166171:0:22724:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00010000:00010000:1.0:1788305993.166214:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e000/0x4a426866e60557e9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.166234:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e000/0x4a426866e60557e9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.166247:0:22724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e000/0x4a426866e60557e9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.166255:0:22724:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e000/0x4a426866e60557e9 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.166261:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e000/0x4a426866e60557e9 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.166267:0:22724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e000/0x4a426866e60557e9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.166332:0:22724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788305993.169260:0:22710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305993.169290:0:22710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e000/0x4a426866e60557e9 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.169306:0:22710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88918390e000 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305993.169311:0:22710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e000/0x4a426866e60557e9 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.169350:0:22710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e000/0x4a426866e60557e9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.169388:0:22710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8891bb166f00) 00010000:00010000:2.0:1788305993.169392:0:22710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788305993.169405:0:22710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e000/0x4a426866e60557e9 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.169412:0:22710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88918390e000/0x4a426866e60557e9 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.169440:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305993.169442:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305993.169444:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305993.169998:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+24:18881:x1875173994315392:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 4283us (4740us total) trans 12884901929 rc 0/0 00000100:00100000:1.0:1788305993.170010:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 14 00000020:00080000:1.0:1788305993.170019:0:22724:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788305993.278755:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305993.278870:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994315648 00000100:00100000:1.0:1788305993.278884:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994315648 00000100:00100000:1.0:1788305993.278963:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 72 00000100:00100000:1.0:1788305993.278974:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+24:18891:x1875173994315648:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788305993.279008:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305993.279055:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88918390ea00/0x4a426866e60557f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08b56 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305993.279900:0:22722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788305993.280051:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88918390ea00/0x4a426866e60557f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b56 expref: 26 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.280302:0:22722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891885c8800) 00010000:00010000:1.0:1788305993.280307:0:22722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788305993.280315:0:22722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88918390ea00/0x4a426866e60557f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08b56 expref: 26 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305993.280340:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88918390ea00, rc 0) 00000100:00100000:1.0:1788305993.280626:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+25:18891:x1875173994315648:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 1652us (1885us total) trans 12884901930 rc 301/301 00000100:00100000:1.0:1788305993.280636:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 72 00000100:00100000:3.0:1788305993.284721:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305993.284822:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994315776 00000100:00100000:2.0:1788305993.284837:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994315776 00000100:00100000:2.0:1788305993.284934:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 73 00000100:00100000:2.0:1788305993.284948:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c124fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+25:18891:x1875173994315776:12345-192.168.202.55@tcp:34:lfs.0 00010000:00010000:2.0:1788305993.285091:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557fe lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285115:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557fe lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285129:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557fe lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285160:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e6055805 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285192:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e6055805 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285199:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e6055805 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285362:0:22721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605580c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285383:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605580c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285391:0:22721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605580c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788305993.285468:0:22721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605580c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285485:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557fe lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285493:0:22721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557fe lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285501:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557fe lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285508:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183564400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305993.285513:0:22721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557fe lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285522:0:22721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557fe lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285547:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8891885c8100) 00010000:00010000:2.0:1788305993.285550:0:22721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305993.285556:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557fe lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285562:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183564400/0x4a426866e60557fe lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285576:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e6055805 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285582:0:22721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e6055805 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285587:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e6055805 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285593:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183564000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305993.285596:0:22721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e6055805 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285601:0:22721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e6055805 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285620:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8891c20f9d00) 00010000:00010000:2.0:1788305993.285622:0:22721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305993.285625:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e6055805 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285631:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183564000/0x4a426866e6055805 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285659:0:22721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605580c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285666:0:22721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605580c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285673:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605580c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285677:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183564800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305993.285680:0:22721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605580c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285686:0:22721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605580c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285693:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:2.0:1788305993.285695:0:22721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305993.285698:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605580c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305993.285703:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183564800/0x4a426866e605580c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305993.286784:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c124fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+25:18891:x1875173994315776:12345-192.168.202.55@tcp:34:lfs.0 Request processed in 1828us (2070us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305993.286798:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 73 00000100:00100000:3.0:1788305993.290101:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305993.290670:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994316032 00000100:00100000:0.0:1788305993.290704:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994316032 00000100:00100000:0.0:1788305993.290786:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:0.0:1788305993.290799:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c124ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+25:18891:x1875173994316032:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:0.0:1788305993.291121:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c124ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+26:18891:x1875173994316032:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 323us (1051us total) trans 12884901931 rc 0/0 00000100:00100000:0.0:1788305993.291130:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 15 00010000:00010000:2.0:1788305993.437189:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305994.459551:0:24891:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305994.710326:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305994.710364:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015397248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305994.710475:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305994.710556:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015397248 00000100:00100000:2.0:1788305994.710564:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015397248 00000100:00100000:2.0:1788305994.710633:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788305994.710645:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188561f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875174015397248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788305994.710679:0:24235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788305994.710734:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188561f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875174015397248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305994.710741:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788305994.710766:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015397376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305994.710805:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788305994.710840:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305994.710855:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015397376 00000100:00100000:2.0:1788305994.710858:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015397376 00000100:00100000:2.0:1788305994.710889:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788305994.710896:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889188562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015397376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788305994.710924:0:22726:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788305994.710958:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889188562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015397376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305994.710963:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788305994.711401:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015397376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305994.711506:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015397248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305994.862108:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305994.862150:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305994.862194:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994316288 00000100:00100000:1.0:1788305994.862205:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305994.862210:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994316288 00000100:00100000:1.0:1788305994.862248:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305994.862334:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305994.862368:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305994.862398:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305994.862415:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305994.862462:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994316800 00000100:00100000:3.0:1788305994.862466:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994316800 00000100:00100000:3.0:1788305994.862507:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994316416 00000100:00100000:3.0:1788305994.862510:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994316416 00000100:00100000:3.0:1788305994.862528:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994316928 00000100:00100000:3.0:1788305994.862530:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994316928 00000100:00100000:1.0:1788305994.862541:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305994.862576:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 65 00000100:00100000:3.0:1788305994.862588:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c1248380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+26:2397:x1875173994316288:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305994.862613:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 66 00000100:00100000:1.0:1788305994.862632:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:2397:x1875173994316800:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305994.862733:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c1248380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+26:2397:x1875173994316288:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 146us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305994.862744:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 65 00000100:00100000:3.0:1788305994.862767:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 67 00000100:00100000:3.0:1788305994.862774:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+5:2397:x1875173994316416:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305994.862803:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82e7fd09-0853-4033-81ad-9c2ffd2628a0+5:2397:x1875173994316416:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 30us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305994.862810:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 67 00000100:00100000:3.0:1788305994.862833:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 68 00000100:00100000:0.0:1788305994.862835:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994316544 00000100:00100000:3.0:1788305994.862845:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908218b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e482d8f-ec3a-4afe-a831-3f7381c98170+5:2397:x1875173994316928:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305994.862846:0:24232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994316544 00000100:00100000:3.0:1788305994.862884:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908218b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8e482d8f-ec3a-4afe-a831-3f7381c98170+5:2397:x1875173994316928:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 42us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305994.862892:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 68 00000100:00100000:0.0:1788305994.862903:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994317056 00000100:00100000:0.0:1788305994.862908:0:24232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994317056 00000100:00100000:0.0:1788305994.862922:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994316672 00000100:00100000:0.0:1788305994.862924:0:24232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994316672 00000100:00100000:0.0:1788305994.862935:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994317184 00000100:00100000:0.0:1788305994.862937:0:24232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994317184 00000100:00100000:0.0:1788305994.862953:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00100000:0.0:1788305994.862961:0:24232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c124b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+8:2397:x1875173994316544:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305994.863022:0:24232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c124b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+8:2397:x1875173994316544:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 62us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305994.863029:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00100000:0.0:1788305994.863046:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 29 00000100:00100000:0.0:1788305994.863054:0:24232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+5:2397:x1875173994317056:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305994.863081:0:24232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+5:2397:x1875173994317056:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 29us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305994.863089:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 29 00000100:00080000:3.0:1788305994.863093:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788305994.863110:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:0.0:1788305994.863116:0:24232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+5:2397:x1875173994316672:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305994.863151:0:24232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+5:2397:x1875173994316672:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 34us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305994.863158:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:0.0:1788305994.863168:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 31 00000100:00100000:0.0:1788305994.863173:0:24232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+5:2397:x1875173994317184:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305994.863193:0:24232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+5:2397:x1875173994317184:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 20us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305994.863199:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 31 00000100:00080000:3.0:1788305994.863232:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788305994.863241:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788305994.863243:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305994.863964:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8e482d8f-ec3a-4afe-a831-3f7381c98170+6:2397:x1875173994316800:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 1334us (1756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305994.863976:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 66 00000100:00100000:1.0:1788305994.864023:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994316160 00000100:00100000:1.0:1788305994.864028:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994316160 00000100:00100000:1.0:1788305994.864062:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 169 00000100:00100000:1.0:1788305994.864070:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083098c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8ba539-95ac-42db-9f6d-9f19c8062908+13:2397:x1875173994316160:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305994.864097:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083098c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3f8ba539-95ac-42db-9f6d-9f19c8062908+13:2397:x1875173994316160:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 28us (1765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305994.864104:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 169 00000100:00100000:1.0:1788305995.221666:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305995.221701:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015397504:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788305995.221801:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305995.221870:0:23464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015397504 00000100:00100000:1.0:1788305995.221880:0:23464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015397504 00000100:00100000:1.0:1788305995.221963:0:23464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788305995.221974:0:23464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908218bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015397504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788305995.222021:0:23464:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788305995.222091:0:23464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908218bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015397504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305995.222099:0:23464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788305995.222163:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889188563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015397504:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1788305995.312818:0:25808:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:2.0:1788305995.489578:0:22710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305995.733629:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305995.733664:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891c124dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015397632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788305995.733761:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305995.733926:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015397632 00000100:00100000:3.0:1788305995.733941:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015397632 00000100:00100000:3.0:1788305995.734043:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788305995.734057:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015397632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788305995.734090:0:24235:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788305995.734152:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015397632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305995.734170:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788305995.734470:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305995.734521:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891c124dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015397632:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1788305995.990210:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788305996.408764:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305996.408842:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305996.409005:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994317312 00000100:00100000:3.0:1788305996.409021:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994317312 00002000:00100000:3.0:1788305996.409110:0:24236:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff8890844fa300 x1875173994317312/t0(0) o4->82e7fd09-0853-4033-81ad-9c2ffd2628a0@192.168.202.55@tcp:172/0 lens 504/0 e 0 to 0 dl 1788306007 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788305996.409123:0:24236:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8890844fa300 with x1875173994317312 ext(0->8) 00002000:00010000:3.0:1788305996.409131:0:24236:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8890844fa300 00000100:00100000:3.0:1788305996.409179:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:3.0:1788305996.409192:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+8:2398:x1875173994317312:12345-192.168.202.55@tcp:4:bash.0 00000100:00080000:0.0:1788305996.410141:0:22717:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305996.410208:0:24232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994317440 00000100:00100000:1.0:1788305996.410216:0:24232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994317440 00000100:00100000:1.0:1788305996.410269:0:24232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 31 00000100:00100000:1.0:1788305996.410314:0:24232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+11:2398:x1875173994317440:12345-192.168.202.55@tcp:16:kworker.0 00000100:00100000:0.0:1788305996.410518:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82e7fd09-0853-4033-81ad-9c2ffd2628a0+11:2398:x1875173994317312:12345-192.168.202.55@tcp:4:bash.0 Request processed in 1328us (1674us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788305996.410532:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 0 00002000:00100000:0.0:1788305996.410542:0:24236:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff8890844fa300 x1875173994317312/t12884901895(0) o4->82e7fd09-0853-4033-81ad-9c2ffd2628a0@192.168.202.55@tcp:172/0 lens 504/448 e 0 to 0 dl 1788306007 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788305996.410553:0:24236:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8890844fa300 with x1875173994317312 ext(0->8) 00002000:00010000:0.0:1788305996.410558:0:24236:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8890844fa300 00000001:00080000:3.0:1788305996.415832:0:24227:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:3.0:1788305996.415855:0:24227:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00000100:00100000:0.0:1788305996.416117:0:24232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82e7fd09-0853-4033-81ad-9c2ffd2628a0+6:2398:x1875173994317440:12345-192.168.202.55@tcp:16:kworker.0 Request processed in 5797us (7357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305996.416132:0:24232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 31 00010000:00010000:2.0:1788305996.501551:0:22711:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 15260 lines, 15260 kept, 0 dropped, 0 bad.